00000001:02000400:3.0F:1788663974.555492:0:3292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788663993.451035:0:3513:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1788663995.717400:0:3576:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 625 MB/s 00000001:01000000:3.0:1788663995.968731:0:3576:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 454 MB/s 00000001:01000000:2.0F:1788663996.218982:0:3576:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3155 MB/s 00000020:02000000:2.0:1788663997.067822:0:3605:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_4_g3b30273 00000400:02000000:1.0:1788663998.083292:0:3620:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.152@tcp [8/256/0/180] 00008000:02000000:3.0:1788664002.153026:0:3770:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788664059.325418:0:5738:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788664073.449285:0:6487:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:2.0:1788664073.449291:0:6487:0:(obd_mount.c:924:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788664073.449293:0:6487:0:(obd_mount.c:927:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788664073.451747:0:6487:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000003bb5ad78 00000080:02000400:1.0:1788664073.452018:0:6487:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788664073.464812:0:6487:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788664073.464826:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788664073.464864:0:6487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004caf1500) 00000020:00000080:1.0:1788664073.464886:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788664073.588176:0:6487:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788664073.588248:0:6487:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1788664073.639301:0:6487:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788664073.640246:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788664073.640256:0:6487:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788664073.640268:0:6487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413d224 00000020:01000004:0.0:1788664073.640275:0:6487:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788664073.640280:0:6487:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788664073.640284:0:6487:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003bb5ad78 from MGS 00000020:01000004:0.0:1788664073.640288:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788664073.640305:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000007a720dac) 00000020:00000080:0.0:1788664073.640316:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788664073.648510:0:6487:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003bb5ad78 from MGS, refs=2 00080000:01000000:1.0:1788664073.648528:0:6487:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788664073.648538:0:6487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413d232 00000100:00100000:1.0:1788664073.648675:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788664073.654040:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788664073.654234:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788664073.660590:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788664073.660605:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788664073.672423:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788664073.672596:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788664073.672602:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788664073.674059:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788664073.674068:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788664073.674834:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788664073.674841:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788664073.676544:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664073.676548:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664073.676550:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664073.676814:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664073.676816:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664073.676818:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664073.680152:0:6487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788664073.683617:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788664073.932275:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1515 MB/s 00000001:01000000:3.0:1788664074.183266:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2127 MB/s 00000001:01000000:3.0:1788664074.433687:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 599 MB/s 00000001:01000000:2.0:1788664074.682951:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1175 MB/s 00010000:00010000:3.0:1788664074.685945:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788664074.686706:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1788664074.693832:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788664074.694497:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788664074.694539:0:6487:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788664074.694578:0:6487:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788664074.694833:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788664074.694856:0:6487:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788664074.695311:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788664074.695539:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788664074.695547:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788664074.696543:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788664074.696553:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788664074.697092:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788664074.697100:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788664074.697508:0:6507:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1788664074.697531:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788664074.697548:0:6487:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.152@tcp' 00000020:01000004:3.0:1788664074.697550:0:6487:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788664074.697589:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.152@tcp (typ=mgc) 00000020:00000080:3.0:1788664074.697608:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.152@tcp (0000000030259153) 00000020:00000080:3.0:1788664074.697692:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788664074.697904:0:6487:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000bd460e84@MGC192.168.203.152@tcp: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788664074.698035:0:6487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.152@tcp-0 is initialized 00000040:01000000:3.0:1788664074.698041:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788664074.698843:0:6508:0:(mgc_request.c:629:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788664074.698874:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.152@tcp (uuid a681e771-e9ab-478d-af58-39fce2e20de6) 00000020:00000080:3.0:1788664074.698890:0:6487:0:(genops.c:1385:class_connect()) connect: client a681e771-e9ab-478d-af58-39fce2e20de6, cookie 0xcd11f61c1413d240 00000100:00080000:3.0:1788664074.698905:0:6487:0:(import.c:545:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788664074.698911:0:6487:0:(import.c:665:import_select_connection()) MGC192.168.203.152@tcp: import 00000000bd460e84 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788664074.698952:0:6487:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b8a9880b x1875550140366976/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788664074.698972:0:6487:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a681e771-e9ab-478d-af58-39fce2e20de6->MGS 00000020:01000004:3.0:1788664074.698988:0:6487:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788664074.698993:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788664074.699003:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006eef6c16) 00000020:00000080:3.0:1788664074.699012:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788664074.702423:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8a9880b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a681e771-e9ab-478d-af58-39fce2e20de6:3635:1875550140366976:0@lo:250: 00000100:00100000:0.0:1788664074.702535:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664074.702683:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140366976 00000100:00100000:0.0:1788664074.702692:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140366976 00000100:00100000:0.0:1788664074.702723:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664074.702728:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc659572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3635:x1875550140366976:12345-0@lo:250: 00010000:00080000:0.0:1788664074.702755:0:6504:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a681e771-e9ab-478d-af58-39fce2e20de6@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:0.0:1788664074.702795:0:6504:0:(genops.c:1385:class_connect()) connect: client a681e771-e9ab-478d-af58-39fce2e20de6, cookie 0xcd11f61c1413d24e 00000100:00080000:0.0:1788664074.702970:0:6504:0:(import.c:65:import_set_state_nolock()) 00000000924fb2fe : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788664074.703022:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc659572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+5:3635:x1875550140366976:12345-0@lo:250: Request processed in 292us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664074.703030:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664074.703077:0:3635:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788664074.703085:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.152@tcp: connect to target with instance 0 00000100:00080000:0.0:1788664074.703092:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788664074.703096:0:3635:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788664074.703100:0:3635:0:(import.c:65:import_set_state_nolock()) 00000000bd460e84 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788664074.703102:0:3635:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788664074.703119:0:3635:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788664074.703131:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8a9880b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a681e771-e9ab-478d-af58-39fce2e20de6:3635:1875550140366976:0@lo:250: 00000100:00100000:3.0:1788664074.712140:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788664074.712355:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788664074.712361:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788664074.713320:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788664074.713328:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788664074.713893:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788664074.713901:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788664074.714550:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788664074.714857:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788664074.714864:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788664074.715396:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788664074.715403:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788664074.746626:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788664074.746973:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788664074.746980:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788664074.747991:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788664074.748001:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788664074.748531:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788664074.748689:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788664074.748694:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788664074.749443:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788664074.749452:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788664074.750199:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664074.750369:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788664074.750374:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788664074.750980:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788664074.750987:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788664074.751563:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664074.751867:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788664074.751874:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788664074.752385:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788664074.752391:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788664074.767437:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788664074.767644:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788664074.767650:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788664074.771013:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788664074.771030:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788664074.772618:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788664074.772631:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788664074.773902:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788664074.773946:0:6487:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788664074.773953:0:6487:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788664074.774067:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788664074.774117:0:6487:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788664074.774122:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788664074.774124:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788664074.774125:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664074.774127:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664074.774128:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664074.774129:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664074.774130:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788664074.774132:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788664074.774133:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788664074.774134:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788664074.774136:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664074.774141:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788664074.774143:0:6487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788664074.774146:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788664074.774147:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788664074.774148:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664074.774149:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664074.774150:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664074.774151:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664074.774152:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788664074.774153:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788664074.774154:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788664074.774154:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788664074.774155:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664074.774156:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788664074.774181:0:6487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788664074.774208:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140367104:0@lo:253: 00000100:00100000:3.0:1788664074.774289:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664074.774334:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140367104 00000100:00100000:3.0:1788664074.774342:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140367104 00000100:00100000:3.0:1788664074.774389:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664074.774398:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f65e2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+5:6487:x1875550140367104:12345-0@lo:253: 20000000:01000000:3.0:1788664074.774448:0:6506:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788664074.774451:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:3.0:1788664074.774597:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e1ebdfd going to sleep for 11 seconds 10000000:01000000:1.0:1788664074.775002:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788664074.775124:0:6506:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788664074.775407:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664074.776487:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788664074.776856:0:6506:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788664074.776860:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788664074.776866:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788664074.776870:0:6506:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788664074.776880:0:6506:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788664074.777021:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788664074.777209:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788664074.777222:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788664074.777239:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788664074.777266:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788664074.777279:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788664074.777350:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788664074.777358:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788664074.777369:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788664074.777374:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788664074.777384:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788664074.777389:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788664074.777417:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788664074.777433:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788664074.777459:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788664074.777463:0:6506:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788664074.777469:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788664074.777539:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788664074.777547:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788664074.777558:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788664074.777568:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788664074.777578:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788664074.777584:0:6506:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788664074.777601:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788664074.777606:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788664074.777615:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788664074.777625:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788664074.777635:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788664074.777641:0:6506:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788664074.777655:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788664074.777659:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788664074.777668:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788664074.777678:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788664074.778334:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788664074.778361:0:6506:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788664074.778367:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788664074.778950:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788664074.779165:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788664074.779186:0:6506:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.152@tcp for mdt 20000000:01000000:3.0:1788664074.779188:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:3.0:1788664074.779215:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788664074.779222:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788664074.779234:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788664074.779239:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:3.0:1788664074.779250:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788664074.779257:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788664074.779268:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788664074.779281:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788664074.779303:0:6506:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788664074.779306:0:6506:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788664074.779309:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788664074.779353:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788664074.779355:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788664074.779533:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788664074.779610:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788664074.779628:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788664074.779642:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788664074.779648:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788664074.779650:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788664074.780822:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788664074.781140:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788664074.781162:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788664074.781176:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1788664074.781252:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788664074.781256:0:6506:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788664074.781261:0:6506:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788664074.781264:0:6506:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788664074.781269:0:6506:0:(mgs_llog.c:5071:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788664074.781275:0:6506:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788664074.781595:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788664074.781885:0:6506:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788664074.790017:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788664074.790061:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788664074.790114:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788664074.790138:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788664074.790159:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bfde98bf/0xcd11f61c1413d255 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.790175:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bfde98bf/0xcd11f61c1413d255 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.790184:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bfde98bf/0xcd11f61c1413d255 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.790190:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bfde98bf/0xcd11f61c1413d255 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.790196:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bfde98bf/0xcd11f61c1413d255 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.790202:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bfde98bf/0xcd11f61c1413d255 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.790208:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bfde98bf already unused, calling callback (0000000001315907) 00010000:00010000:3.0:1788664074.790211:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bfde98bf/0xcd11f61c1413d255 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.790218:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bfde98bf/0xcd11f61c1413d255 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.790229:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bfde98bf/0xcd11f61c1413d255 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.790242:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bfde98bf/0xcd11f61c1413d255 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.790248:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bfde98bf/0xcd11f61c1413d255 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788664074.790268:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788664074.799167:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f65e2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+5:6487:x1875550140367104:12345-0@lo:253: Request processed in 24762us (24870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664074.799192:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664074.799560:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140367104:0@lo:253: 10000000:01000000:3.0:1788664074.799575:0:6487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788664074.799578:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788664074.799580:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788664074.799581:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664074.799582:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788664074.799584:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664074.799585:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664074.799586:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788664074.799588:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788664074.799589:0:6487:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788664074.799591:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664074.799592:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788664074.799611:0:6487:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003bb5ad78 from lustre-MDT0000 10000000:01000000:3.0:1788664074.799638:0:6487:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788664074.799641:0:6487:0:(mgc_request.c:327:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788664074.799645:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93c422744d40 10000000:01000000:3.0:1788664074.799649:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788664074.799667:0:6487:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff93c422744d40 from 1 10000000:01000000:3.0:1788664074.799670:0:6487:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788664074.799705:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000bfde98bf/0xcd11f61c1413d25c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.800028:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000bfde98bf/0xcd11f61c1413d25c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.800056:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000bfde98bf/0xcd11f61c1413d25c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664074.800075:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140367232:0@lo:101: 00000100:00100000:3.0:1788664074.800145:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664074.800237:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000bfa567 going to sleep for 11 seconds 00000100:00100000:0.0:1788664074.800325:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140367232 00000100:00100000:0.0:1788664074.800332:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140367232 00000100:00100000:0.0:1788664074.800463:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788664074.800472:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000701a2df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+5:6487:x1875550140367232:12345-0@lo:101: 00010000:00010000:0.0:1788664074.800485:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664074.800499:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006037babc/0xcd11f61c1413d263 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d25c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664074.800520:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006037babc/0xcd11f61c1413d263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d25c expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664074.800535:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006037babc/0xcd11f61c1413d263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d25c expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664074.800544:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006037babc, rc 0) 00000100:00100000:0.0:1788664074.800585:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000701a2df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+6:6487:x1875550140367232:12345-0@lo:101: Request processed in 116us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664074.800592:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664074.800648:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140367232:0@lo:101: 00010000:00010000:3.0:1788664074.800677:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000bfde98bf/0xcd11f61c1413d25c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d263 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.800685:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000bfde98bf/0xcd11f61c1413d25c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d263 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664074.800826:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140367360:0@lo:501: 00000100:00100000:3.0:1788664074.800852:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664074.801079:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000bfa567 going to sleep for 11 seconds 00000100:00100000:1.0:1788664074.801171:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140367360 00000100:00100000:1.0:1788664074.801183:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140367360 00000100:00100000:1.0:1788664074.801216:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788664074.801222:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fcb47781 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+6:6487:x1875550140367360:12345-0@lo:501: 00000100:00100000:1.0:1788664074.801333:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fcb47781 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+6:6487:x1875550140367360:12345-0@lo:501: Request processed in 111us (481us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788664074.801340:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788664074.801455:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140367360:0@lo:501: 10000000:01000000:3.0:1788664074.801481:0:6487:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788664074.801498:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000bfde98bf/0xcd11f61c1413d25c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d263 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.801506:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000bfde98bf/0xcd11f61c1413d25c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d263 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664074.801515:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c40641a800 10000000:01000000:3.0:1788664074.801519:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788664074.801528:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93c40641a800 10000000:01000000:3.0:1788664074.801531:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788664074.801534:0:6487:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-barrier-ffff93c40641a800 from 1 10000000:01000000:3.0:1788664074.801536:0:6487:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788664074.801552:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 000000008844b69a/0xcd11f61c1413d26a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.801558:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 000000008844b69a/0xcd11f61c1413d26a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.801565:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 000000008844b69a/0xcd11f61c1413d26a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664074.801576:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140367488:0@lo:101: 00000100:00100000:3.0:1788664074.801599:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664074.801621:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000bfa567 going to sleep for 11 seconds 00000100:00100000:2.0:1788664074.801800:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140367488 00000100:00100000:2.0:1788664074.801805:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140367488 00000100:00100000:2.0:1788664074.801832:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788664074.801837:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006de75763 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+6:6487:x1875550140367488:12345-0@lo:101: 00010000:00010000:2.0:1788664074.801845:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664074.801855:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b524babe/0xcd11f61c1413d271 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d26a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664074.801879:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b524babe/0xcd11f61c1413d271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d26a expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664074.801886:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b524babe/0xcd11f61c1413d271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d26a expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664074.801892:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b524babe, rc 0) 00000100:00100000:2.0:1788664074.802015:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006de75763 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+7:6487:x1875550140367488:12345-0@lo:101: Request processed in 177us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664074.802022:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788664074.802274:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140367488:0@lo:101: 00010000:00010000:3.0:1788664074.802285:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 000000008844b69a/0xcd11f61c1413d26a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d271 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.802292:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 000000008844b69a/0xcd11f61c1413d26a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d271 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664074.802303:0:6487:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788664074.802343:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 000000008844b69a/0xcd11f61c1413d26a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d271 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.802352:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 000000008844b69a/0xcd11f61c1413d26a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d271 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664074.802376:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788664074.802379:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788664074.802383:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93c40641a800 10000000:01000000:3.0:1788664074.802386:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788664074.802388:0:6487:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788664074.802390:0:6487:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788664074.802404:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.802411:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.802417:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664074.802428:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140367616:0@lo:101: 00000100:00100000:3.0:1788664074.802454:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664074.802482:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000bfa567 going to sleep for 11 seconds 00000100:00100000:2.0:1788664074.802574:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140367616 00000100:00100000:2.0:1788664074.802579:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140367616 00000100:00100000:2.0:1788664074.802604:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788664074.802621:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f22f90a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+7:6487:x1875550140367616:12345-0@lo:101: 00010000:00010000:2.0:1788664074.802628:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664074.802635:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000f8742ae/0xcd11f61c1413d27f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d278 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664074.802647:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000f8742ae/0xcd11f61c1413d27f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d278 expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664074.802654:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000f8742ae/0xcd11f61c1413d27f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d278 expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664074.802660:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000f8742ae, rc 0) 00000100:00100000:2.0:1788664074.802695:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f22f90a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+8:6487:x1875550140367616:12345-0@lo:101: Request processed in 76us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664074.802709:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664074.802805:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140367616:0@lo:101: 00010000:00010000:3.0:1788664074.802815:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d27f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.802821:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d27f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664074.802863:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140367744:0@lo:501: 00000100:00100000:3.0:1788664074.802886:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664074.802920:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000bfa567 going to sleep for 11 seconds 00000100:00100000:0.0:1788664074.803162:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140367744 00000100:00100000:0.0:1788664074.803167:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140367744 00000100:00100000:0.0:1788664074.803200:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788664074.803206:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053ef7ff1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+8:6487:x1875550140367744:12345-0@lo:501: 00000100:00100000:0.0:1788664074.803309:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053ef7ff1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+9:6487:x1875550140367744:12345-0@lo:501: Request processed in 104us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664074.803315:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664074.803373:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140367744:0@lo:501: 00000100:00100000:3.0:1788664074.803396:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140367872:0@lo:503: 00000100:00100000:3.0:1788664074.803432:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664074.803453:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000bfa567 going to sleep for 11 seconds 00000100:00100000:1.0:1788664074.803493:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140367872 00000100:00100000:1.0:1788664074.803497:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140367872 00000100:00100000:1.0:1788664074.803526:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788664074.803531:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000314ddd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+9:6487:x1875550140367872:12345-0@lo:503: 00000100:00100000:1.0:1788664074.803615:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000314ddd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+9:6487:x1875550140367872:12345-0@lo:503: Request processed in 85us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664074.803621:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788664074.803687:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140367872:0@lo:503: 00000100:00100000:3.0:1788664074.804219:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:6533:1875550140368000:0@lo:502: 00000100:00100000:3.0:1788664074.804266:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664074.804391:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set 00000000baea8636 going to sleep for 11 seconds 00000100:00100000:1.0:1788664074.804894:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140368000 00000100:00100000:1.0:1788664074.804899:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140368000 00000100:00100000:1.0:1788664074.804925:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788664074.804999:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009de11070 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+9:6533:x1875550140368000:12345-0@lo:502: 00000100:00100000:1.0:1788664074.805085:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009de11070 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+9:6533:x1875550140368000:12345-0@lo:502: Request processed in 89us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664074.805092:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788664074.807434:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:6533:1875550140368000:0@lo:502: 00000020:01000000:3.0:1788664074.807483:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664074.807497:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664074.807499:0:6533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788664074.807505:0:6533:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788664074.807510:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788664074.807525:0:6533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000dcefea5a) 00000020:00000080:3.0:1788664074.807545:0:6533:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788664074.807549:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788664074.807648:0:6533:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788664074.807661:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413d28d 00000020:00000080:3.0:1788664074.807953:0:6533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788664074.807958:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664074.807961:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664074.807963:0:6533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788664074.807965:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664074.807969:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664074.807970:0:6533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788664074.807973:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788664074.807980:0:6533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000108cc440) 00000020:00000080:3.0:1788664074.807997:0:6533:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788664074.808001:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788664074.808003:0:6533:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788664074.808005:0:6533:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788664074.808011:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788664074.808081:0:6533:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003bb5ad78 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788664074.808100:0:6533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ce615106) 00000020:00000080:3.0:1788664074.808120:0:6533:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788664074.808178:0:6533:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788664074.808183:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd11f61c1413d2a2 00000020:00000080:3.0:1788664074.808299:0:6533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788664074.808305:0:6533:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788664074.808309:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcd11f61c1413d2a9 00080000:01000000:3.0:1788664074.808314:0:6533:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788664074.808317:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413d2b0 00080000:10000000:3.0:1788664074.808675:0:6533:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788664074.808844:0:6533:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788664074.818503:0:6533:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788664074.881230:0:6533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788664074.881521:0:6533:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788664074.883796:0:6533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788664074.884091:0:6533:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788664074.890902:0:6533:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000caed6671) 00000020:00000080:2.0:1788664074.890942:0:6533:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788664074.892850:0:6533:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788664074.892930:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413d2be 00000020:00000080:1.0:1788664074.900650:0:6533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788664074.902628:0:6533:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1788664074.908544:0:6533:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1788664074.920043:0:6533:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1788664074.923377:0:6533:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1788664074.932224:0:6533:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788664074.937541:0:6533:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788664074.939021:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcd11f61c1413d2c5 00000020:00000080:0.0:1788664074.939513:0:6533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788664074.939525:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664074.939531:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664074.939534:0:6533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788664074.939537:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788664074.939541:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664074.939543:0:6533:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788664074.939546:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788664074.939547:0:6533:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788664074.939550:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664074.939552:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664074.939553:0:6533:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788664074.939555:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788664074.939559:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664074.939561:0:6533:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788664074.939576:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788664074.939616:0:6533:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788664074.939676:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e980f7c pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:6533:1875550140368128:0@lo:502: 00000100:00100000:0.0:1788664074.940237:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664074.940334:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051cd8f49 going to sleep for 11 seconds 00000100:00100000:1.0:1788664074.940476:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140368128 00000100:00100000:1.0:1788664074.940484:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140368128 00000100:00100000:1.0:1788664074.940567:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788664074.940576:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061c3a9c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+9:6533:x1875550140368128:12345-0@lo:502: 00000100:00100000:1.0:1788664074.940697:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061c3a9c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+9:6533:x1875550140368128:12345-0@lo:502: Request processed in 122us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664074.940894:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788664074.941061:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e980f7c pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:6533:1875550140368128:0@lo:502: 00000020:01000000:3.0:1788664074.941091:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664074.941097:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664074.941099:0:6533:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788664074.941103:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788664074.941217:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788664074.941237:0:6487:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788664074.941255:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d27f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664074.941265:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d27f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664074.941272:0:6487:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c40641a800 from 1 10000000:01000000:2.0:1788664074.941275:0:6487:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788664074.941310:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d2cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664074.941317:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d2cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664074.941325:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d2cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664074.941340:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd6f0c5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140368256:0@lo:101: 00000100:00100000:2.0:1788664074.941446:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664074.941475:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000005f4c2f1a going to sleep for 11 seconds 00000100:00100000:1.0:1788664074.941546:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140368256 00000100:00100000:1.0:1788664074.941552:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140368256 00000100:00100000:1.0:1788664074.941612:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788664074.941621:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000111386f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+9:6487:x1875550140368256:12345-0@lo:101: 00010000:00010000:1.0:1788664074.941632:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664074.941647:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000024b734dd/0xcd11f61c1413d2d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d2cc expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664074.941667:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000024b734dd/0xcd11f61c1413d2d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d2cc expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664074.941677:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000024b734dd/0xcd11f61c1413d2d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d2cc expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664074.941685:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000024b734dd, rc 0) 00000100:00100000:1.0:1788664074.941737:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000111386f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+10:6487:x1875550140368256:12345-0@lo:101: Request processed in 118us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664074.941744:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788664074.941814:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd6f0c5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140368256:0@lo:101: 00010000:00010000:2.0:1788664074.941827:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d2cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d2d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664074.941834:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d2cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d2d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664074.942560:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd6f0c5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140368384:0@lo:256: 00000100:00100000:2.0:1788664074.942611:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664074.942644:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000005f4c2f1a going to sleep for 11 seconds 00000100:00100000:1.0:1788664074.942702:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140368384 00000100:00100000:1.0:1788664074.942709:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140368384 00000100:00100000:1.0:1788664074.942735:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788664074.942742:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3baa904 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+10:6487:x1875550140368384:12345-0@lo:256: 20000000:01000000:1.0:1788664074.942757:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788664074.942762:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788664074.942849:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3baa904 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+10:6487:x1875550140368384:12345-0@lo:256: Request processed in 108us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664074.942855:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788664074.943131:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd6f0c5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140368384:0@lo:256: 10000000:01000000:2.0:1788664074.944158:0:6487:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788664074.944235:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d2cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d2d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664074.944246:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d2cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d2d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664074.944315:0:6487:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c40641a800 from 1 10000000:01000000:3.0:1788664074.944319:0:6487:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788664074.944351:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000fb1cbd50/0xcd11f61c1413d2da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.944381:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000fb1cbd50/0xcd11f61c1413d2da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.944390:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000fb1cbd50/0xcd11f61c1413d2da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664074.944410:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140368512:0@lo:101: 00000100:00100000:3.0:1788664074.944461:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664074.944559:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1f49654 going to sleep for 11 seconds 00000100:00100000:1.0:1788664074.945225:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140368512 00000100:00100000:1.0:1788664074.945233:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140368512 00000100:00100000:1.0:1788664074.945286:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788664074.945295:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a15bc7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+10:6487:x1875550140368512:12345-0@lo:101: 00010000:00010000:1.0:1788664074.945308:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664074.945323:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000de29ccc/0xcd11f61c1413d2e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d2da expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664074.945346:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000de29ccc/0xcd11f61c1413d2e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d2da expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664074.945355:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000de29ccc/0xcd11f61c1413d2e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d2da expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664074.945363:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000de29ccc, rc 0) 00000100:00100000:1.0:1788664074.945710:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a15bc7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+11:6487:x1875550140368512:12345-0@lo:101: Request processed in 416us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664074.945718:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788664074.946197:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140368512:0@lo:101: 00010000:00010000:3.0:1788664074.946214:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000fb1cbd50/0xcd11f61c1413d2da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d2e1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.946223:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000fb1cbd50/0xcd11f61c1413d2da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d2e1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664074.946314:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140368640:0@lo:501: 00000100:00100000:3.0:1788664074.946350:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664074.946388:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1f49654 going to sleep for 11 seconds 00000100:00100000:2.0:1788664074.946407:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140368640 00000100:00100000:2.0:1788664074.946414:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140368640 00000100:00100000:2.0:1788664074.946456:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788664074.946464:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d3a210a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+11:6487:x1875550140368640:12345-0@lo:501: 00000100:00100000:2.0:1788664074.946698:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d3a210a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+11:6487:x1875550140368640:12345-0@lo:501: Request processed in 234us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664074.946721:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788664074.947142:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140368640:0@lo:501: 00000100:00100000:3.0:1788664074.947179:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140368768:0@lo:503: 00000100:00100000:3.0:1788664074.947221:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664074.947258:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1f49654 going to sleep for 11 seconds 00000100:00100000:1.0:1788664074.948196:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140368768 00000100:00100000:1.0:1788664074.948205:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140368768 00000100:00100000:1.0:1788664074.948252:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788664074.948259:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a1dc5b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+11:6487:x1875550140368768:12345-0@lo:503: 00000040:00080000:1.0:1788664074.948305:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788664074.948403:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a1dc5b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+11:6487:x1875550140368768:12345-0@lo:503: Request processed in 144us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664074.948411:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788664074.953747:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140368768:0@lo:503: 00000040:00080000:3.0:1788664074.955542:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788664074.956007:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788664074.956030:0:6487:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788664074.956053:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000fb1cbd50/0xcd11f61c1413d2da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d2e1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664074.956081:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000fb1cbd50/0xcd11f61c1413d2da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d2e1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664074.956142:0:6487:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788664074.956145:0:6487:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff93c40641a800 10000000:01000000:1.0:1788664074.956148:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c40641a800 10000000:01000000:1.0:1788664074.956152:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788664074.956157:0:6487:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c40641a800 from 1 10000000:01000000:1.0:1788664074.956160:0:6487:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788664074.956202:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 000000004f96186f/0xcd11f61c1413d2e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664074.956210:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 000000004f96186f/0xcd11f61c1413d2e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664074.956219:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 000000004f96186f/0xcd11f61c1413d2e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664074.956239:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e4c1a39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140368896:0@lo:101: 00000100:00100000:1.0:1788664074.956300:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664074.956350:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000602ff78c going to sleep for 11 seconds 00000100:00100000:2.0:1788664074.958159:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140368896 00000100:00100000:2.0:1788664074.958172:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140368896 00000100:00100000:2.0:1788664074.958239:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788664074.958248:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016fb0fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+11:6487:x1875550140368896:12345-0@lo:101: 00010000:00010000:2.0:1788664074.958267:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664074.958283:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003dd3dd73/0xcd11f61c1413d2ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d2e8 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664074.958315:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003dd3dd73/0xcd11f61c1413d2ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d2e8 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664074.958326:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003dd3dd73/0xcd11f61c1413d2ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d2e8 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664074.958336:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003dd3dd73, rc 0) 00000100:00100000:2.0:1788664074.958415:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016fb0fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+12:6487:x1875550140368896:12345-0@lo:101: Request processed in 169us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664074.958422:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788664074.958511:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e4c1a39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140368896:0@lo:101: 00010000:00010000:3.0:1788664074.958528:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 000000004f96186f/0xcd11f61c1413d2e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d2ef expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.958537:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 000000004f96186f/0xcd11f61c1413d2e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d2ef expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664074.958610:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140369024:0@lo:501: 00000100:00100000:3.0:1788664074.958717:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664074.958756:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca13afc7 going to sleep for 11 seconds 00000100:00100000:0.0:1788664074.958859:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140369024 00000100:00100000:0.0:1788664074.958863:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140369024 00000100:00100000:0.0:1788664074.958887:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788664074.958891:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5d343a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:6487:x1875550140369024:12345-0@lo:501: 00000100:00100000:0.0:1788664074.959000:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5d343a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:6487:x1875550140369024:12345-0@lo:501: Request processed in 108us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664074.959007:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788664074.959169:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140369024:0@lo:501: 00000100:00100000:3.0:1788664074.959197:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140369152:0@lo:503: 00000100:00100000:3.0:1788664074.959241:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664074.959298:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca13afc7 going to sleep for 11 seconds 00000100:00100000:0.0:1788664074.959501:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140369152 00000100:00100000:0.0:1788664074.959506:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140369152 00000100:00100000:0.0:1788664074.959568:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788664074.959575:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a80dcdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:6487:x1875550140369152:12345-0@lo:503: 00000100:00100000:0.0:1788664074.959664:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a80dcdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:6487:x1875550140369152:12345-0@lo:503: Request processed in 90us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664074.959671:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788664074.959713:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140369152:0@lo:503: 00000100:00100000:3.0:1788664074.960285:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:6538:1875550140369280:0@lo:502: 00000100:00100000:3.0:1788664074.960319:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664074.960495:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a16dc6c2 going to sleep for 11 seconds 00000100:00100000:2.0:1788664074.960517:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140369280 00000100:00100000:2.0:1788664074.960523:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140369280 00000100:00100000:2.0:1788664074.960556:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788664074.960563:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d3fcf3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+12:6538:x1875550140369280:12345-0@lo:502: 00000100:00100000:2.0:1788664074.960656:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d3fcf3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+12:6538:x1875550140369280:12345-0@lo:502: Request processed in 93us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664074.960663:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788664074.960715:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1b1b6f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:6538:1875550140369280:0@lo:502: 00000020:01000004:3.0:1788664074.960826:0:6538:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788664074.960840:0:6538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000012012f86) 00000020:00000080:3.0:1788664074.960857:0:6538:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788664074.961003:0:6538:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003bb5ad78 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788664074.961007:0:6538:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003bb5ad78 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788664074.961009:0:6538:0:(obd_mount.c:710:lustre_put_lsi()) put 000000003bb5ad78 4 00010000:00080000:3.0:1788664074.961032:0:6538:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000000a225c8@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1788664074.964602:0:6538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788664074.964969:0:6538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788664074.965016:0:6538:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788664074.965029:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcd11f61c1413d2fd 00000100:00080000:0.0:1788664074.965039:0:6538:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788664074.965044:0:6538:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000000a225c8 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788664074.965075:0:6538:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008a54f961 x1875550140369408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788664074.965148:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a54f961 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875550140369408:0@lo:38: 00000100:00100000:3.0:1788664074.965208:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788664074.965262:0:6538:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788664074.965385:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140369408 00000100:00100000:3.0:1788664074.965394:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140369408 00000100:00100000:0.0:1788664074.965470:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014e3d607 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:6538:1875550140369536:0@lo:502: 00000100:00100000:3.0:1788664074.965487:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788664074.965494:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec1b1b6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1875550140369408:12345-0@lo:38: 00000100:00100000:0.0:1788664074.965515:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664074.965531:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051cd8f49 going to sleep for 11 seconds 00000100:00100000:0.0:1788664074.965546:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140369536 00000100:00100000:3.0:1788664074.965547:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec1b1b6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1875550140369408:12345-0@lo:38: Request processed in 53us (338us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788664074.965550:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140369536 00000100:00100000:3.0:1788664074.965553:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664074.965578:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788664074.965585:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f192dbc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:6538:x1875550140369536:12345-0@lo:502: 00000100:00100000:3.0:1788664074.965586:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788664074.965593:0:3635:0:(import.c:65:import_set_state_nolock()) 0000000000a225c8 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788664074.965597:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788664074.965600:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a54f961 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875550140369408:0@lo:38: 00000100:00100000:0.0:1788664074.965685:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f192dbc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:6538:x1875550140369536:12345-0@lo:502: Request processed in 101us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664074.965693:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788664074.965712:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014e3d607 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:6538:1875550140369536:0@lo:502: 00000040:00080000:3.0:1788664074.965733:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788664074.965799:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788664074.965821:0:6487:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788664074.965837:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 000000004f96186f/0xcd11f61c1413d2e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d2ef expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664074.965846:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 000000004f96186f/0xcd11f61c1413d2e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d2ef expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788664074.965895:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788664074.965898:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788664074.965899:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664074.965900:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788664074.965901:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664074.965902:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664074.965903:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788664074.965905:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788664074.965906:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788664074.965907:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788664074.965908:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664074.965913:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788664074.965916:0:6487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788664074.965967:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788664074.966019:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788664074.966020:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664074.966020:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788664074.966021:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664074.966022:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664074.966023:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788664074.966023:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788664074.966024:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788664074.966024:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788664074.966025:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664074.966026:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788664074.966037:0:6487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788664074.966043:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000317569fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140369664:0@lo:253: 00000100:00100000:0.0:1788664074.966071:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664074.966098:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000baea8636 going to sleep for 11 seconds 00000100:00100000:3.0:1788664074.966121:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140369664 00000100:00100000:3.0:1788664074.966125:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140369664 00000100:00100000:3.0:1788664074.966144:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788664074.966149:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b14434fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:6487:x1875550140369664:12345-0@lo:253: 20000000:01000000:3.0:1788664074.966170:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788664074.966181:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788664074.978362:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788664074.978384:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788664074.978510:0:6527:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788664074.978515:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788664074.978533:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ac90ce04/0xcd11f61c1413d304 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664074.978556:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000024b734dd/0xcd11f61c1413d2d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d2cc expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664074.978563:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ac90ce04/0xcd11f61c1413d304 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664074.978622:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000024b734dd/0xcd11f61c1413d2d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d2cc expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664074.978635:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000024b734dd/0xcd11f61c1413d2d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d2cc expref: 12 pid: 6504 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664074.978648:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ceebe604 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875550140369792:0@lo:104: 00000100:00100000:3.0:1788664074.978670:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b14434fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:6487:x1875550140369664:12345-0@lo:253: Request processed in 12521us (12597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664074.978680:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788664074.978684:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664074.978730:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 000000008f5c4494 going to sleep for 11 seconds 00000100:00100000:2.0:1788664074.978747:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140369792 00000100:00100000:2.0:1788664074.978756:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140369792 00000100:00100000:2.0:1788664074.978821:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788664074.978829:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acdf09e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+3:6527:x1875550140369792:12345-0@lo:104: 00010000:00010000:2.0:1788664074.978846:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d2cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d2d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664074.978891:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664074.978896:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acdf09e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+3:6527:x1875550140369792:12345-0@lo:104: Request processed in 69us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664074.978902:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664074.979004:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000317569fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:6487:1875550140369664:0@lo:253: 10000000:01000000:0.0:1788664074.979017:0:6487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788664074.979021:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788664074.979022:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788664074.979024:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664074.979025:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:1.0:1788664074.979027:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ceebe604 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875550140369792:0@lo:104: 00000020:01000004:0.0:1788664074.979027:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664074.979028:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664074.979029:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788664074.979031:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788664074.979032:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788664074.979033:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788664074.979035:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664074.979036:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1788664074.979042:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ac90ce04/0xcd11f61c1413d304 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1788664074.979048:0:6487:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788664074.979128:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664074.979140:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d2cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d2d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979148:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e3b0710a already unused, calling callback (00000000b4c0f7fd) 10000000:00010000:3.0:1788664074.979151:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d2cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d2d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979158:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d2cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d2d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664074.979164:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d2cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d2d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664074.979169:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788664074.979202:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d2cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d2d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979208:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788664074.979224:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d2cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d2d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979230:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d2cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d2d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979245:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664074.979247:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664074.979249:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664074.979339:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee68d3c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140369920:0@lo:103: 00000100:00100000:1.0:1788664074.979369:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664074.979489:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140369920 00000100:00100000:3.0:1788664074.979494:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140369920 00010000:00010000:3.0:1788664074.979511:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000024b734dd/0xcd11f61c1413d2d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d2cc expref: 12 pid: 6504 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664074.979551:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788664074.979558:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ceebe604 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+12:3637:x1875550140369920:12345-0@lo:103: 00010000:00010000:3.0:1788664074.979569:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664074.979573:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000024b734dd/0xcd11f61c1413d2d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d2cc expref: 12 pid: 6504 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979583:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000024b734dd/0xcd11f61c1413d2d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d2cc expref: 12 pid: 6504 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979595:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000024b734dd/0xcd11f61c1413d2d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d2cc expref: 12 pid: 6504 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979606:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ac90ce04/0xcd11f61c1413d304 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979613:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ac90ce04/0xcd11f61c1413d304 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788664074.979625:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001110600s 00010000:00010000:3.0:1788664074.979628:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ac90ce04/0xcd11f61c1413d304 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979634:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ac90ce04/0xcd11f61c1413d304 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979640:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ac90ce04/0xcd11f61c1413d304 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979645:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ac90ce04/0xcd11f61c1413d304 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979656:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ac90ce04 already unused, calling callback (0000000001315907) 00010000:00010000:3.0:1788664074.979660:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ac90ce04/0xcd11f61c1413d304 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979667:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ac90ce04/0xcd11f61c1413d304 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979686:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ac90ce04/0xcd11f61c1413d304 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664074.979696:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664074.979738:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ceebe604 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+11:3637:x1875550140369920:12345-0@lo:103: Request processed in 182us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664074.979745:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788664074.979800:0:6527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ac90ce04/0xcd11f61c1413d304 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664074.979808:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ac90ce04/0xcd11f61c1413d304 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664074.979813:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ac90ce04/0xcd11f61c1413d304 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664074.979905:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee68d3c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140369920:0@lo:103: 00080000:10000000:0.0:1788664074.984994:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1788664074.985181:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788664074.985874:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1788664074.986067:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788664074.986299:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1788664074.986543:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788664074.987574:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1788664074.987744:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788664074.988216:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1788664074.988424:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788664074.988648:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1788664074.988882:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1788664074.991513:0:6487:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788664075.001558:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788664075.001851:0:6544:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788664075.003330:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788664075.003426:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788664075.003903:0:6487:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788664075.003909:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788664075.004016:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788664075.007606:0:6543:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788664075.007616:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:0.0:1788664075.008062:0:6487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788664075.008666:0:6487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788664075.008701:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788664075.009123:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788664075.009247:0:6544:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788664075.009595:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1788664075.011091:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788664075.011313:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788664075.011466:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788664075.011597:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788664075.011738:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788664075.012189:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788664075.012513:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788664075.012639:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788664075.012812:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788664075.013091:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788664075.014072:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788664075.014245:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788664075.014374:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788664075.014516:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000040:00080000:3.0:1788664075.014554:0:6544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788664075.014630:0:6544:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788664075.014634:0:6544:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1788664075.014666:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788664075.014818:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788664075.016661:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788664075.016883:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788664075.017101:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788664075.017250:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788664075.017365:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788664075.018222:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788664075.018372:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788664075.018495:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788664075.018632:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788664075.018759:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788664075.018898:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788664075.019018:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788664075.019161:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788664075.019283:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788664075.019381:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788664075.019459:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788664075.019606:0:6487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788664075.023440:0:6487:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788664075.023505:0:6487:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaa6d41c6b988 00100000:10000000:3.0:1788664075.023513:0:6487:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788664075.024336:0:6487:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788664075.024349:0:6487:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788664075.024380:0:6487:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788664075.024398:0:6487:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788664075.026254:0:6487:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788664075.026456:0:6487:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788664075.710439:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664076.734048:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664077.758136:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664078.782893:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664079.807554:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788664080.449484:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788664080.449492:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788664080.449494:0:36:0:(import.c:65:import_set_state_nolock()) 0000000000a225c8 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664080.449510:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000000a225c8 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664080.449531:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000025503cec x1875550140370176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664080.449690:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025503cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875550140370176:0@lo:38: 00000100:00100000:2.0:1788664080.449755:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788664080.449848:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788664080.449852:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c40641a800 from 3 10000000:01000000:2.0:1788664080.449855:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788664080.449879:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d30b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664080.449889:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d30b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664080.449900:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d30b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664080.449927:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004544db4a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140370304:0@lo:101: 00000100:00100000:2.0:1788664080.449958:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664080.449979:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3c1ef11 going to sleep for 11 seconds 00000100:00100000:2.0:1788664080.449995:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140370304 00000100:00100000:2.0:1788664080.450001:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140370304 00000100:00100000:2.0:1788664080.450042:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788664080.450049:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4e8fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+11:6508:x1875550140370304:12345-0@lo:101: 00010000:00010000:2.0:1788664080.450061:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664080.450082:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a181e7a/0xcd11f61c1413d312 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d30b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664080.450103:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a181e7a/0xcd11f61c1413d312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d30b expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664080.450111:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a181e7a/0xcd11f61c1413d312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d30b expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664080.450118:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a181e7a, rc 0) 00000100:00100000:2.0:1788664080.450152:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4e8fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+12:6508:x1875550140370304:12345-0@lo:101: Request processed in 104us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664080.450159:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788664080.450222:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004544db4a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140370304:0@lo:101: 00010000:00010000:2.0:1788664080.450235:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d30b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d312 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664080.450243:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d30b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d312 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664080.450302:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004544db4a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140370432:0@lo:256: 00000100:00100000:2.0:1788664080.450331:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664080.450345:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3c1ef11 going to sleep for 11 seconds 00000100:00100000:2.0:1788664080.450357:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140370432 00000100:00100000:2.0:1788664080.450360:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140370432 00000100:00100000:2.0:1788664080.450382:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788664080.450387:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9aacc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:6508:x1875550140370432:12345-0@lo:256: 20000000:01000000:2.0:1788664080.450401:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788664080.450416:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788664080.450420:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788664080.450488:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9aacc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:6508:x1875550140370432:12345-0@lo:256: Request processed in 100us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664080.450495:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788664080.450525:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004544db4a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140370432:0@lo:256: 10000000:01000000:2.0:1788664080.450563:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788664080.450569:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d30b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d312 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664080.450576:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d30b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d312 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664080.450611:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140370176 00000100:00100000:2.0:1788664080.450615:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140370176 00000100:00100000:2.0:1788664080.450635:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664080.450639:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d3b44e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1875550140370176:12345-0@lo:38: 00010000:00080000:2.0:1788664080.450657:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:2.0:1788664080.450693:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcd11f61c1413d319 00000004:00100000:2.0:1788664080.450733:0:6513:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788664080.450905:0:6513:0:(import.c:65:import_set_state_nolock()) 00000000c226a3e3 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664080.450946:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d3b44e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875550140370176:12345-0@lo:38: Request processed in 305us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664080.450953:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788664080.450981:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000025503cec x1875550140370176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788664080.450993:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788664080.451014:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788664080.451019:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788664080.451020:0:3635:0:(import.c:65:import_set_state_nolock()) 0000000000a225c8 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788664080.451026:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025503cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875550140370176:0@lo:38: 00000100:00100000:2.0:1788664080.451121:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664080.451130:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd6f0c5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140370048:0@lo:400: 00000100:00100000:2.0:1788664080.451158:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664080.451224:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140370048 00000100:00100000:2.0:1788664080.451229:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140370048 00000100:00100000:2.0:1788664080.451250:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788664080.451256:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ebb2b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+12:3639:x1875550140370048:12345-0@lo:400: 00000100:00100000:2.0:1788664080.451290:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ebb2b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+12:3639:x1875550140370048:12345-0@lo:400: Request processed in 35us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664080.451295:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788664080.451320:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd6f0c5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140370048:0@lo:400: 00000001:02000400:2.0:1788664080.692041:0:6789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788664080.829836:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788664081.814982:0:6841:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788664081.816015:0:6841:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788664081.858310:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664082.877901:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664083.901997:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788664084.663327:0:6942:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788664084.663539:0:6942:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788664084.926702:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664085.566250:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664085.566274:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025503cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140370688:0@lo:400: 00000100:00100000:2.0:1788664085.566341:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664085.566462:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd6f0c5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140370560:0@lo:400: 00000100:00100000:0.0:1788664085.566506:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664085.566706:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140370688 00000100:00100000:3.0:1788664085.566713:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140370688 00000100:00100000:3.0:1788664085.566764:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788664085.566790:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004544db4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140370688:12345-0@lo:400: 00000100:00100000:3.0:1788664085.567074:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004544db4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140370688:12345-0@lo:400: Request processed in 303us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664085.567082:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788664085.567235:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140370560 00000100:00100000:2.0:1788664085.567239:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140370560 00000100:00100000:2.0:1788664085.567271:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788664085.567276:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae4dfa32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+12:3639:x1875550140370560:12345-0@lo:400: 00000100:00100000:2.0:1788664085.567314:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae4dfa32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+12:3639:x1875550140370560:12345-0@lo:400: Request processed in 39us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664085.567319:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788664085.567450:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd6f0c5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140370560:0@lo:400: 00010000:00080000:1.0:1788664085.567683:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000025503cec x1875550140370688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664085.567697:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025503cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140370688:0@lo:400: 00010000:00010000:3.0:1788664085.950278:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664086.975514:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664087.999924:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664089.027855:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664090.052637:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664090.686404:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000556de21e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140370944:0@lo:400: 00000100:00100000:2.0:1788664090.686484:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664090.686561:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140370944 00000100:00100000:2.0:1788664090.686569:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140370944 00000100:00100000:2.0:1788664090.686614:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664090.686621:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072124b95 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140370944:12345-0@lo:400: 00000100:00100000:2.0:1788664090.686678:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072124b95 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140370944:12345-0@lo:400: Request processed in 58us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664090.686685:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788664090.686726:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000556de21e x1875550140370944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664090.686740:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000556de21e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140370944:0@lo:400: 00000100:00100000:1.0:1788664090.686930:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cebc6239 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140370816:0@lo:400: 00000100:00100000:1.0:1788664090.686967:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664090.687307:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140370816 00000100:00100000:2.0:1788664090.687312:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140370816 00000100:00100000:2.0:1788664090.688080:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788664090.688101:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001e5f56b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:3637:x1875550140370816:12345-0@lo:400: 00000100:00100000:2.0:1788664090.688161:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001e5f56b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:3637:x1875550140370816:12345-0@lo:400: Request processed in 74us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664090.688167:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788664090.688245:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cebc6239 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140370816:0@lo:400: 00010000:00010000:3.0:1788664091.070082:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664092.094017:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664093.117906:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664094.143151:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664095.166923:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664095.807319:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000464c34d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140371200:0@lo:400: 00000100:00100000:0.0:1788664095.807390:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664095.807464:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140371200 00000100:00100000:0.0:1788664095.807471:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140371200 00000100:00100000:0.0:1788664095.807514:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788664095.807522:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d241378a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140371200:12345-0@lo:400: 00000100:00100000:0.0:1788664095.807766:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d241378a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140371200:12345-0@lo:400: Request processed in 245us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664095.807795:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788664095.807832:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000464c34d2 x1875550140371200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664095.807846:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000464c34d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140371200:0@lo:400: 00000100:00100000:3.0:1788664095.809084:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664095.809102:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000317569fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140371072:0@lo:400: 00000100:00100000:3.0:1788664095.809153:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664095.809542:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140371072 00000100:00100000:0.0:1788664095.809549:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140371072 00000100:00100000:0.0:1788664095.809602:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788664095.809610:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001abf767d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+12:3638:x1875550140371072:12345-0@lo:400: 00000100:00100000:0.0:1788664095.809668:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001abf767d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+12:3638:x1875550140371072:12345-0@lo:400: Request processed in 59us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664095.809686:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788664095.813081:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000317569fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140371072:0@lo:400: 00010000:00010000:2.0:1788664096.190944:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788664096.349223:0:7441:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:2.0:1788664096.349235:0:7441:0:(obd_mount.c:924:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788664096.349236:0:7441:0:(obd_mount.c:927:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788664096.349517:0:7441:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000000b8730be 00000020:01000004:2.0:1788664096.349535:0:7441:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788664096.349546:0:7441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788664096.349559:0:7441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000013d67be2) 00000020:00000080:2.0:1788664096.349572:0:7441:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788664096.415182:0:7441:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1788664096.415259:0:7441:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1788664096.437096:0:7441:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788664096.437434:0:7441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788664096.437450:0:7441:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788664096.437461:0:7441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd11f61c1413d327 00000020:01000004:0.0:1788664096.437468:0:7441:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788664096.437501:0:7441:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788664096.437504:0:7441:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788664096.437510:0:7441:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788664096.437545:0:7441:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788664096.437556:0:7441:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788664096.454450:0:7441:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788664096.454519:0:7441:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1788664096.454523:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788664096.454525:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788664096.454527:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664096.454527:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664096.454528:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664096.454529:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664096.454531:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788664096.454532:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788664096.454534:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788664096.454535:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664096.454536:0:7441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788664096.454539:0:7441:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1788664096.454541:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788664096.454543:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788664096.454544:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664096.454545:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664096.454546:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664096.454547:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664096.454553:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788664096.454553:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788664096.454554:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788664096.454555:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664096.454556:0:7441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788664096.454696:0:7441:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788664096.454714:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140371328:0@lo:253: 00000100:00100000:1.0:1788664096.454860:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664096.454983:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000007e7ac756 going to sleep for 11 seconds 00000100:00100000:2.0:1788664096.455156:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140371328 00000100:00100000:2.0:1788664096.455164:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140371328 00000100:00100000:2.0:1788664096.455216:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788664096.455225:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b490916f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:7441:x1875550140371328:12345-0@lo:253: 20000000:01000000:2.0:1788664096.455265:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788664096.455269:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1788664096.455272:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1788664096.455275:0:6506:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1788664096.455307:0:6506:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1788664096.455476:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788664096.455573:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788664096.455585:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788664096.455601:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788664096.455615:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788664096.457021:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788664096.457218:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1788664096.457240:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1788664096.457259:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1788664096.457279:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1788664096.457293:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1788664096.457311:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1788664096.457326:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788664096.457362:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788664096.457504:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1788664096.457513:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:2.0:1788664096.457542:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1788664096.457549:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788664096.457592:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1788664096.457599:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:2.0:1788664096.457624:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1788664096.457630:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788664096.457655:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788664096.457685:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788664096.457697:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788664096.458128:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1788664096.458138:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1788664096.458150:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788664096.458164:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788664096.458179:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1788664096.458184:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1788664096.458195:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788664096.458234:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788664096.458241:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1788664096.458261:0:6506:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788664096.458273:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1788664096.458684:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788664096.459065:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788664096.459084:0:6506:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.152@tcp for mdt 20000000:01000000:2.0:1788664096.459086:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:2.0:1788664096.459097:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788664096.459101:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788664096.459110:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788664096.459114:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:2.0:1788664096.459126:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788664096.459132:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1788664096.459142:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1788664096.459153:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1788664096.459189:0:6506:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1788664096.459196:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1788664096.459448:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1788664096.459664:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788664096.459678:0:6506:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.152@tcp for mdt 20000000:01000000:2.0:1788664096.459679:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:2.0:1788664096.459757:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788664096.459767:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788664096.459953:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788664096.459971:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:2.0:1788664096.459985:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788664096.459992:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1788664096.460004:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788664096.460017:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1788664096.460034:0:6506:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788664096.460037:0:6506:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788664096.460041:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788664096.460084:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788664096.460086:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788664096.460454:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788664096.460475:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788664096.460489:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788664096.460741:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788664096.460975:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788664096.461002:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788664096.461011:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788664096.461012:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788664096.464177:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788664096.464230:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788664096.464243:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1788664096.464492:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788664096.464540:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788664096.464559:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1788664096.464570:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788664096.464572:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788664096.465605:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788664096.465634:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788664096.465661:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788664096.466100:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788664096.466123:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788664096.466149:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788664096.466164:0:6506:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788664096.466167:0:6506:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788664096.466171:0:6506:0:(mgs_llog.c:5071:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788664096.466177:0:6506:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788664096.466628:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788664096.466920:0:6506:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788664096.480759:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788664096.480822:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000045c039fa/0xcd11f61c1413d32e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.480844:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006037babc/0xcd11f61c1413d263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d25c expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.480851:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000f8742ae/0xcd11f61c1413d27f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d278 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.480858:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003dd3dd73/0xcd11f61c1413d2ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d2e8 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.482204:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000045c039fa/0xcd11f61c1413d32e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.482719:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003dd3dd73/0xcd11f61c1413d2ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d2e8 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.482735:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003dd3dd73/0xcd11f61c1413d2ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d2e8 expref: 12 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664096.482750:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023fca439 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140371456:0@lo:104: 00000100:00100000:3.0:1788664096.485186:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664096.485422:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000f8742ae/0xcd11f61c1413d27f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d278 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.485440:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000f8742ae/0xcd11f61c1413d27f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d278 expref: 12 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664096.485461:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000012afddfb pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140371584:0@lo:104: 00000100:00100000:3.0:1788664096.485495:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664096.487117:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006037babc/0xcd11f61c1413d263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d25c expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.487132:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006037babc/0xcd11f61c1413d263 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d25c expref: 12 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664096.487143:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000162b7f5e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140371712:0@lo:104: 00000100:00100000:3.0:1788664096.487185:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664096.487365:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140371456 00000100:00100000:2.0:1788664096.487373:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140371456 00000100:00100000:2.0:1788664096.487413:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140371584 00000100:00100000:2.0:1788664096.487415:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140371584 00000100:00100000:2.0:1788664096.487429:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664096.487436:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da67f619 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:6506:x1875550140371456:12345-0@lo:104: 00010000:00010000:2.0:1788664096.487448:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 000000004f96186f/0xcd11f61c1413d2e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d2ef expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.487504:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664096.487509:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da67f619 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:6506:x1875550140371456:12345-0@lo:104: Request processed in 74us (2332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664096.487516:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664096.487533:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664096.487538:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c11c7e46 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:6506:x1875550140371584:12345-0@lo:104: 00010000:00010000:2.0:1788664096.487545:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d27f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.487578:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788664096.487584:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c11c7e46 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:6506:x1875550140371584:12345-0@lo:104: Request processed in 46us (2088us total) trans 0 rc 0/0 00010000:00010000:0.0:1788664096.487584:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664096.487593:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 000000004f96186f/0xcd11f61c1413d2e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d2ef expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664096.487594:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788664096.487604:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004f96186f already unused, calling callback (00000000b4c0f7fd) 10000000:00010000:0.0:1788664096.487608:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 000000004f96186f/0xcd11f61c1413d2e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d2ef expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.487614:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664096.487617:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 000000004f96186f/0xcd11f61c1413d2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d2ef expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664096.487625:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 000000004f96186f/0xcd11f61c1413d2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d2ef expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664096.487631:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664096.487664:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 000000004f96186f/0xcd11f61c1413d2e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d2ef expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.487672:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664096.487687:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 000000004f96186f/0xcd11f61c1413d2e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d2ef expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.487694:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 000000004f96186f/0xcd11f61c1413d2e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d2ef expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.487725:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664096.487727:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664096.487729:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664096.487758:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664096.487790:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d27f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.487799:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000079393a9f already unused, calling callback (00000000b4c0f7fd) 10000000:00010000:2.0:1788664096.487801:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d27f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.487808:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d27f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664096.487814:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d27f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664096.487816:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000464c34d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140371840:0@lo:103: 10000000:01000000:2.0:1788664096.487827:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664096.487850:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d27f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.487858:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788664096.487859:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664096.487878:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d278 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d27f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.487886:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d27f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664096.487909:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140371840 00000100:00100000:0.0:1788664096.487914:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140371840 00010000:00010000:0.0:1788664096.487930:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003dd3dd73/0xcd11f61c1413d2ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d2e8 expref: 13 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664096.487953:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788664096.487959:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc4691bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+13:3637:x1875550140371840:12345-0@lo:103: 00010000:00010000:0.0:1788664096.487980:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664096.487984:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003dd3dd73/0xcd11f61c1413d2ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d2e8 expref: 13 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.487994:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003dd3dd73/0xcd11f61c1413d2ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d2e8 expref: 13 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.488009:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664096.488037:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc4691bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+13:3637:x1875550140371840:12345-0@lo:103: Request processed in 79us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664096.488044:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788664096.488079:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664096.488081:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664096.488083:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000464c34d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140371840:0@lo:103: 00010000:00010000:2.0:1788664096.488085:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664096.488099:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000556de21e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140371968:0@lo:103: 00000100:00100000:2.0:1788664096.488127:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664096.488162:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664096.488164:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664096.488222:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140371968 00000100:00100000:0.0:1788664096.488226:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140371968 00010000:00010000:0.0:1788664096.488239:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000f8742ae/0xcd11f61c1413d27f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d278 expref: 13 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664096.488313:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788664096.488319:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf175ed7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+13:3638:x1875550140371968:12345-0@lo:103: 00010000:00010000:0.0:1788664096.488328:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664096.488331:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000f8742ae/0xcd11f61c1413d27f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d278 expref: 13 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.488339:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000f8742ae/0xcd11f61c1413d27f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d278 expref: 13 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.488349:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664096.488382:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf175ed7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+13:3638:x1875550140371968:12345-0@lo:103: Request processed in 64us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664096.488389:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788664096.488725:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140371712 00000100:00100000:1.0:1788664096.488730:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140371712 00000100:00100000:3.0:1788664096.488756:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086b1b918 going to sleep for 11 seconds 00000100:00100000:1.0:1788664096.488759:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788664096.488784:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6106dd9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+3:6506:x1875550140371712:12345-0@lo:104: 00010000:00010000:1.0:1788664096.488794:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000bfde98bf/0xcd11f61c1413d25c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d263 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.488802:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003dd3dd73/0xcd11f61c1413d2ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d2e8 expref: 12 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664096.488815:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023fca439 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140371456:0@lo:104: 00010000:00010000:3.0:1788664096.488827:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000f8742ae/0xcd11f61c1413d27f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d278 expref: 11 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664096.488835:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000012afddfb pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140371584:0@lo:104: 00000100:00100000:0.0:1788664096.490580:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000556de21e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140371968:0@lo:103: 00000100:00100000:3.0:1788664096.490653:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000162b7f5e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140371712:0@lo:104: 00010000:00010000:1.0:1788664096.490660:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788664096.490669:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6106dd9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+3:6506:x1875550140371712:12345-0@lo:104: Request processed in 1901us (3482us total) trans 0 rc 0/0 00010000:00010000:3.0:1788664096.490676:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000045c039fa/0xcd11f61c1413d32e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664096.490680:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788664096.490741:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664096.490750:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000bfde98bf/0xcd11f61c1413d25c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d263 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.490758:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bfde98bf already unused, calling callback (00000000b4c0f7fd) 10000000:00010000:0.0:1788664096.490762:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000bfde98bf/0xcd11f61c1413d25c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d263 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491036:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000bfde98bf/0xcd11f61c1413d25c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d263 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664096.491046:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000bfde98bf/0xcd11f61c1413d25c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d263 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664096.491065:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664096.491311:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000bfde98bf/0xcd11f61c1413d25c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d263 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491319:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664096.491348:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000bfde98bf/0xcd11f61c1413d25c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d263 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491364:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000bfde98bf/0xcd11f61c1413d25c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d263 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491383:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664096.491384:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664096.491386:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664096.491432:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000464c34d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140372096:0@lo:103: 00000100:00100000:1.0:1788664096.491481:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664096.491588:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140372096 00000100:00100000:0.0:1788664096.491595:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140372096 00010000:00010000:0.0:1788664096.491618:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006037babc/0xcd11f61c1413d263 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d25c expref: 11 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664096.491678:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664096.491686:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a941835c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+11:3639:x1875550140372096:12345-0@lo:103: 00010000:00010000:0.0:1788664096.491697:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664096.491702:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006037babc/0xcd11f61c1413d263 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d25c expref: 11 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491711:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006037babc/0xcd11f61c1413d263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d25c expref: 11 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491723:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006037babc/0xcd11f61c1413d263 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d25c expref: 11 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491742:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000045c039fa/0xcd11f61c1413d32e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491750:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045c039fa/0xcd11f61c1413d32e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491763:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000045c039fa/0xcd11f61c1413d32e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491804:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000045c039fa/0xcd11f61c1413d32e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491811:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000045c039fa/0xcd11f61c1413d32e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491816:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000045c039fa/0xcd11f61c1413d32e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491821:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000045c039fa already unused, calling callback (0000000001315907) 00010000:00010000:0.0:1788664096.491824:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000045c039fa/0xcd11f61c1413d32e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491831:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000045c039fa/0xcd11f61c1413d32e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491844:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000045c039fa/0xcd11f61c1413d32e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.491852:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664096.491901:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a941835c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+10:3639:x1875550140372096:12345-0@lo:103: Request processed in 216us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664096.491916:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788664096.492060:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000464c34d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140372096:0@lo:103: 00010000:00010000:3.0:1788664096.492170:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000045c039fa/0xcd11f61c1413d32e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.492178:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000045c039fa/0xcd11f61c1413d32e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.492183:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000045c039fa/0xcd11f61c1413d32e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788664096.492199:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788664096.494418:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b490916f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+9:7441:x1875550140371328:12345-0@lo:253: Request processed in 39188us (39553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664096.494433:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788664096.494538:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140371328:0@lo:253: 10000000:01000000:1.0:1788664096.494555:0:7441:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788664096.494558:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788664096.494560:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788664096.494562:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664096.494563:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1788664096.494564:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664096.494566:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664096.494567:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788664096.494568:0:7441:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788664096.494570:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664096.494571:0:7441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788664096.494590:0:7441:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000b8730be from lustre-MDT0001 10000000:01000000:1.0:1788664096.494625:0:7441:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788664096.494628:0:7441:0:(mgc_request.c:327:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788664096.494635:0:7441:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93c422744d40 local copy 10000000:01000000:1.0:1788664096.494638:0:7441:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788664096.494671:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000174cc2e3/0xcd11f61c1413d335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.494681:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.152@tcp lock: 00000000174cc2e3/0xcd11f61c1413d335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.494690:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000174cc2e3/0xcd11f61c1413d335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664096.494707:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140372224:0@lo:101: 00000100:00100000:1.0:1788664096.494744:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664096.494872:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7689c6a going to sleep for 11 seconds 00000100:00100000:2.0:1788664096.495144:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140372224 00000100:00100000:2.0:1788664096.495152:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140372224 00000100:00100000:3.0:1788664096.495350:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788664096.495359:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069b44562 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+9:7441:x1875550140372224:12345-0@lo:101: 00010000:00010000:3.0:1788664096.495373:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664096.495386:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000011e60adb/0xcd11f61c1413d33c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d335 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.495407:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011e60adb/0xcd11f61c1413d33c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d335 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.495417:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000011e60adb/0xcd11f61c1413d33c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d335 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.495424:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000011e60adb, rc 0) 00000100:00100000:3.0:1788664096.495469:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069b44562 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+10:7441:x1875550140372224:12345-0@lo:101: Request processed in 111us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664096.495494:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788664096.495558:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140372224:0@lo:101: 00010000:00010000:1.0:1788664096.495580:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000174cc2e3/0xcd11f61c1413d335 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcd11f61c1413d33c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.495593:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000174cc2e3/0xcd11f61c1413d335 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd11f61c1413d33c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664096.495683:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140372352:0@lo:501: 00000100:00100000:1.0:1788664096.495711:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664096.495802:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7689c6a going to sleep for 11 seconds 00000100:00100000:0.0:1788664096.495899:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140372352 00000100:00100000:0.0:1788664096.495905:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140372352 00000100:00100000:0.0:1788664096.495927:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788664096.495940:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000617fb580 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+10:7441:x1875550140372352:12345-0@lo:501: 00000100:00100000:0.0:1788664096.496015:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000617fb580 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+10:7441:x1875550140372352:12345-0@lo:501: Request processed in 82us (304us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788664096.496021:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788664096.496158:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140372352:0@lo:501: 10000000:01000000:1.0:1788664096.496176:0:7441:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788664096.496193:0:7441:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788664096.496197:0:7441:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000174cc2e3/0xcd11f61c1413d335 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd11f61c1413d33c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.496204:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000174cc2e3/0xcd11f61c1413d335 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd11f61c1413d33c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.496223:0:7441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: 00000000174cc2e3/0xcd11f61c1413d335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd11f61c1413d33c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.496245:0:7441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788664096.496269:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c42d99f800 10000000:01000000:1.0:1788664096.496274:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788664096.496279:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93c422744d40 10000000:01000000:1.0:1788664096.496281:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788664096.496284:0:7441:0:(mgc_request.c:1800:mgc_process_log()) Process log nodemap-ffff93c422744d40 from 1 10000000:01000000:1.0:1788664096.496286:0:7441:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788664096.496303:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 000000003910aeb6/0xcd11f61c1413d343 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.496323:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 000000003910aeb6/0xcd11f61c1413d343 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.496332:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 000000003910aeb6/0xcd11f61c1413d343 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664096.496344:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140372480:0@lo:101: 00000100:00100000:1.0:1788664096.496371:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664096.496383:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c2fb099 going to sleep for 11 seconds 00010000:00010000:0.0:1788664096.496544:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664096.496549:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000174cc2e3/0xcd11f61c1413d335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcd11f61c1413d33c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.496557:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000174cc2e3 already unused, calling callback (00000000b4c0f7fd) 10000000:00010000:0.0:1788664096.496559:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000174cc2e3/0xcd11f61c1413d335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcd11f61c1413d33c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.496567:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000174cc2e3/0xcd11f61c1413d335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xcd11f61c1413d33c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664096.496574:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000174cc2e3/0xcd11f61c1413d335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xcd11f61c1413d33c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664096.496579:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664096.496598:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000174cc2e3/0xcd11f61c1413d335 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd11f61c1413d33c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.496605:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664096.496630:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000174cc2e3/0xcd11f61c1413d335 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd11f61c1413d33c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.496650:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000174cc2e3/0xcd11f61c1413d335 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd11f61c1413d33c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.496671:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664096.496673:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664096.496674:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664096.496681:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664096.496692:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017362a6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140372608:0@lo:103: 00000100:00100000:0.0:1788664096.496720:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664096.496747:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140372480 00000100:00100000:0.0:1788664096.496751:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140372480 00000100:00100000:0.0:1788664096.496816:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788664096.496823:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000989f57de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+10:7441:x1875550140372480:12345-0@lo:101: 00010000:00010000:0.0:1788664096.496832:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664096.496843:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006037babc/0xcd11f61c1413d34a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d343 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.496860:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006037babc/0xcd11f61c1413d34a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d343 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.496869:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006037babc/0xcd11f61c1413d34a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d343 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.496906:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006037babc, rc 0) 00000100:00100000:0.0:1788664096.497076:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000989f57de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+11:7441:x1875550140372480:12345-0@lo:101: Request processed in 253us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664096.497082:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788664096.497136:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140372608 00000100:00100000:0.0:1788664096.497140:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140372608 00000100:00100000:0.0:1788664096.497172:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664096.497177:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2bc758d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+11:3637:x1875550140372608:12345-0@lo:103: 00010000:00010000:0.0:1788664096.497186:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664096.497295:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000011e60adb/0xcd11f61c1413d33c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d335 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.497308:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664096.497356:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2bc758d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+10:3637:x1875550140372608:12345-0@lo:103: Request processed in 179us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664096.497363:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664096.497399:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017362a6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140372608:0@lo:103: 00000100:00100000:1.0:1788664096.497552:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140372480:0@lo:101: 00010000:00010000:1.0:1788664096.497569:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 000000003910aeb6/0xcd11f61c1413d343 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d34a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.497577:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 000000003910aeb6/0xcd11f61c1413d343 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d34a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664096.497592:0:7441:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788664096.497610:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 000000003910aeb6/0xcd11f61c1413d343 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d34a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.497617:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 000000003910aeb6/0xcd11f61c1413d343 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d34a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664096.497626:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93c42d99f800 10000000:01000000:1.0:1788664096.497630:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788664096.497634:0:7441:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-barrier-ffff93c42d99f800 from 1 10000000:01000000:1.0:1788664096.497636:0:7441:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788664096.497659:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000b36e2d48/0xcd11f61c1413d351 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.497672:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000b36e2d48/0xcd11f61c1413d351 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.497687:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000b36e2d48/0xcd11f61c1413d351 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664096.497720:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140372736:0@lo:101: 00000100:00100000:1.0:1788664096.497751:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664096.497794:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c2fb099 going to sleep for 11 seconds 00000100:00100000:3.0:1788664096.497913:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140372736 00000100:00100000:3.0:1788664096.497919:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140372736 00000100:00100000:3.0:1788664096.498090:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788664096.498098:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f45563b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+10:7441:x1875550140372736:12345-0@lo:101: 00010000:00010000:3.0:1788664096.498115:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664096.498125:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cc7deb89/0xcd11f61c1413d358 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d351 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.498152:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cc7deb89/0xcd11f61c1413d358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d351 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.498161:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cc7deb89/0xcd11f61c1413d358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d351 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.498167:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cc7deb89, rc 0) 00000100:00100000:3.0:1788664096.498289:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f45563b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+11:7441:x1875550140372736:12345-0@lo:101: Request processed in 112us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664096.498296:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788664096.498387:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140372736:0@lo:101: 00010000:00010000:1.0:1788664096.498401:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000b36e2d48/0xcd11f61c1413d351 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d358 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.498408:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000b36e2d48/0xcd11f61c1413d351 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d358 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664096.498418:0:7441:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788664096.498421:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000b36e2d48/0xcd11f61c1413d351 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d358 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.498427:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000b36e2d48/0xcd11f61c1413d351 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d358 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664096.498433:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788664096.498436:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788664096.498440:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93c42d99f800 10000000:01000000:1.0:1788664096.498444:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788664096.498446:0:7441:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788664096.498456:0:7441:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788664096.498473:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000bc33dfd4/0xcd11f61c1413d35f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.498479:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000bc33dfd4/0xcd11f61c1413d35f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.498486:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000bc33dfd4/0xcd11f61c1413d35f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664096.498498:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140372864:0@lo:101: 00000100:00100000:1.0:1788664096.498521:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664096.498570:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c2fb099 going to sleep for 11 seconds 00000100:00100000:0.0:1788664096.498645:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140372864 00000100:00100000:0.0:1788664096.498659:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140372864 00000100:00100000:0.0:1788664096.498679:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788664096.498692:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b64de13f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+11:7441:x1875550140372864:12345-0@lo:101: 00010000:00010000:0.0:1788664096.498700:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664096.498709:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb29acd4/0xcd11f61c1413d366 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d35f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.498729:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb29acd4/0xcd11f61c1413d366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d35f expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.498737:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb29acd4/0xcd11f61c1413d366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d35f expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.498743:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb29acd4, rc 0) 00000100:00100000:0.0:1788664096.498812:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b64de13f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+12:7441:x1875550140372864:12345-0@lo:101: Request processed in 128us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664096.498832:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788664096.499096:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140372864:0@lo:101: 00010000:00010000:1.0:1788664096.499110:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000bc33dfd4/0xcd11f61c1413d35f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d366 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.499124:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000bc33dfd4/0xcd11f61c1413d35f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d366 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664096.499310:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140372992:0@lo:501: 00000100:00100000:1.0:1788664096.499345:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664096.499379:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c2fb099 going to sleep for 11 seconds 00000100:00100000:0.0:1788664096.499442:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140372992 00000100:00100000:0.0:1788664096.499447:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140372992 00000100:00100000:0.0:1788664096.499485:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788664096.499491:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000220fd87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+12:7441:x1875550140372992:12345-0@lo:501: 00000100:00100000:0.0:1788664096.499621:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000220fd87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+12:7441:x1875550140372992:12345-0@lo:501: Request processed in 130us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664096.499636:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788664096.499712:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140372992:0@lo:501: 00000100:00100000:1.0:1788664096.499754:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140373120:0@lo:503: 00000100:00100000:1.0:1788664096.499833:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664096.499853:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c2fb099 going to sleep for 11 seconds 00000100:00100000:0.0:1788664096.500319:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140373120 00000100:00100000:0.0:1788664096.500324:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140373120 00000100:00100000:0.0:1788664096.500344:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788664096.500348:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cfd8b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+12:7441:x1875550140373120:12345-0@lo:503: 00000100:00100000:0.0:1788664096.500427:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cfd8b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+12:7441:x1875550140373120:12345-0@lo:503: Request processed in 78us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664096.500434:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788664096.500532:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140373120:0@lo:503: 00000040:00080000:1.0:1788664096.500796:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788664096.500873:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140373248:0@lo:502: 00000100:00100000:1.0:1788664096.500911:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664096.501080:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140373248 00000100:00100000:3.0:1788664096.501085:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140373248 00000100:00100000:3.0:1788664096.501107:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788664096.501113:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008515fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+12:7441:x1875550140373248:12345-0@lo:502: 00000100:00100000:3.0:1788664096.501194:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008515fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+12:7441:x1875550140373248:12345-0@lo:502: Request processed in 80us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664096.501200:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788664096.501527:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c2fb099 going to sleep for 11 seconds 00000100:00100000:1.0:1788664096.501547:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140373248:0@lo:502: 00000040:00080000:1.0:1788664096.502064:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788664096.502095:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788664096.502106:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788664096.502115:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788664096.502125:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788664096.502134:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788664096.502143:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788664096.502153:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788664096.502162:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788664096.502172:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788664096.502181:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788664096.502191:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788664096.502200:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788664096.502279:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788664096.502310:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788664096.502322:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788664096.502333:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788664096.502344:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788664096.502354:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788664096.502365:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788664096.502376:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788664096.502387:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788664096.502397:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788664096.502425:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140373376:0@lo:502: 00000100:00100000:1.0:1788664096.502472:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664096.502545:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c2fb099 going to sleep for 11 seconds 00000100:00100000:0.0:1788664096.502588:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140373376 00000100:00100000:0.0:1788664096.502595:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140373376 00000100:00100000:0.0:1788664096.502672:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788664096.502680:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e1eced9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+12:7441:x1875550140373376:12345-0@lo:502: 00000100:00100000:0.0:1788664096.502804:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e1eced9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+12:7441:x1875550140373376:12345-0@lo:502: Request processed in 125us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664096.502812:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788664096.502885:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140373376:0@lo:502: 00000040:00080000:1.0:1788664096.502945:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788664096.502953:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1788664096.503502:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664096.503514:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664096.503516:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788664096.503521:0:7454:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788664096.503523:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788664096.503536:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000831586ad) 00000020:00000080:1.0:1788664096.503554:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1788664096.503559:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788664096.503639:0:7454:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788664096.503646:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd11f61c1413d374 00000020:00000080:1.0:1788664096.503893:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788664096.503900:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664096.503904:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664096.503906:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788664096.503908:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664096.503911:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664096.503912:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788664096.503915:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788664096.503922:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000280a27a0) 00000020:00000080:1.0:1788664096.503943:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1788664096.503948:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788664096.503949:0:7454:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788664096.503952:0:7454:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788664096.503957:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788664096.504016:0:7454:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000b8730be from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788664096.504027:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000490d8f60) 00000020:00000080:1.0:1788664096.504035:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1788664096.504084:0:7454:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788664096.504092:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd11f61c1413d389 00000020:00000080:1.0:1788664096.504184:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788664096.504190:0:7454:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788664096.504194:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xcd11f61c1413d390 00080000:01000000:1.0:1788664096.504200:0:7454:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788664096.504202:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd11f61c1413d397 00080000:10000000:1.0:1788664096.504569:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788664096.504675:0:7454:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1788664096.659132:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1788664096.660477:0:7454:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1788664096.667548:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788664096.669156:0:7454:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788664096.684371:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788664096.684398:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664096.684407:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664096.684409:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788664096.684413:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664096.684421:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664096.684422:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788664096.684425:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788664096.684432:0:7454:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:00000080:3.0:1788664096.684538:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788664096.684556:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000006685cd92) 00000020:00000080:3.0:1788664096.684580:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788664096.684586:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788664096.685276:0:7454:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788664096.685285:0:7454:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788664096.685293:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd11f61c1413d3a5 00010000:00080000:2.0:1788664096.685344:0:7454:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000039314396@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788664096.689240:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1788664096.691043:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788664096.691058:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788664096.691104:0:7454:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788664096.691127:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd11f61c1413d3ac 00000100:00080000:2.0:1788664096.691137:0:7454:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788664096.691143:0:7454:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000039314396 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664096.691190:0:7454:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000075d376cd x1875550140373504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788664096.692411:0:7454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788664096.692536:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140373632:0@lo:400: 00000020:01000000:2.0:1788664096.692597:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1788664096.692598:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788664096.692606:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664096.692609:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788664096.692613:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788664096.692616:0:7454:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788664096.692618:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788664096.692619:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788664096.692621:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788664096.692624:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664096.692626:0:7454:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788664096.692629:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664096.692635:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664096.692637:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788664096.692641:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788664096.692737:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140373632 00000100:00100000:3.0:1788664096.692746:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140373632 00000100:00100000:3.0:1788664096.692808:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788664096.692818:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065c6cef0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140373632:12345-0@lo:400: 00000100:00100000:3.0:1788664096.692877:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065c6cef0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140373632:12345-0@lo:400: Request processed in 61us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664096.692885:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788664096.692925:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008684162f x1875550140373632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000004:01000000:2.0:1788664096.692989:0:7454:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788664096.693007:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664096.693010:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664096.693011:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788664096.693014:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664096.693016:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664096.693017:0:7454:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788664096.693020:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788664096.693021:0:7454:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788664096.693052:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664096.693054:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664096.693057:0:7454:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788664096.693061:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1788664096.693076:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140373632:0@lo:400: 00000100:00100000:0.0:1788664096.693157:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075d376cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140373504:0@lo:38: 00000020:01000000:3.0:1788664096.693332:0:7441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1788664096.693362:0:7441:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788664096.693418:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000bc33dfd4/0xcd11f61c1413d35f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d366 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.693429:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000bc33dfd4/0xcd11f61c1413d35f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d366 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664096.693437:0:7441:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c42d99f800 from 1 10000000:01000000:3.0:1788664096.693439:0:7441:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788664096.693479:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000b6262ca0/0xcd11f61c1413d3b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664096.693480:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664096.693490:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000b6262ca0/0xcd11f61c1413d3b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.693502:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000b6262ca0/0xcd11f61c1413d3b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664096.693518:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000162b7f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140373760:0@lo:101: 00000100:00100000:3.0:1788664096.693550:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664096.693581:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0710070 going to sleep for 11 seconds 00000100:00100000:1.0:1788664096.693748:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140373760 00000100:00100000:1.0:1788664096.693754:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140373760 00000100:00100000:1.0:1788664096.693815:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788664096.693823:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fd60c5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+12:7441:x1875550140373760:12345-0@lo:101: 00010000:00010000:1.0:1788664096.693831:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664096.693842:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000011097d49/0xcd11f61c1413d3ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d3b3 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.693863:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011097d49/0xcd11f61c1413d3ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d3b3 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.693873:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000011097d49/0xcd11f61c1413d3ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d3b3 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.693881:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000011097d49, rc 0) 00000100:00100000:1.0:1788664096.693912:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fd60c5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+13:7441:x1875550140373760:12345-0@lo:101: Request processed in 91us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664096.693925:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788664096.694018:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000162b7f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140373760:0@lo:101: 00010000:00010000:3.0:1788664096.694030:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000b6262ca0/0xcd11f61c1413d3b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d3ba expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.694038:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000b6262ca0/0xcd11f61c1413d3b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d3ba expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664096.694932:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000162b7f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140373888:0@lo:256: 00000100:00100000:3.0:1788664096.694990:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664096.695054:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0710070 going to sleep for 11 seconds 00000100:00100000:2.0:1788664096.695141:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140373504 00000100:00100000:2.0:1788664096.695148:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140373504 00000100:00100000:2.0:1788664096.695187:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788664096.695193:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017362a6f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1875550140373504:12345-0@lo:38: 00010000:00080000:2.0:1788664096.695224:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1788664096.695257:0:6516:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd11f61c1413d3c1 00000004:00100000:2.0:1788664096.695270:0:6516:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788664096.695275:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788664096.695616:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140373888 00000100:00100000:1.0:1788664096.695621:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140373888 00000100:00100000:1.0:1788664096.695744:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788664096.695753:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098d0e918 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+13:7441:x1875550140373888:12345-0@lo:256: 20000000:01000000:1.0:1788664096.695804:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788664096.696848:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788664096.696856:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788664096.697094:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098d0e918 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+13:7441:x1875550140373888:12345-0@lo:256: Request processed in 1342us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664096.697105:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788664096.697332:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000162b7f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140373888:0@lo:256: 10000000:01000000:2.0:1788664096.699986:0:7441:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788664096.700005:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000b6262ca0/0xcd11f61c1413d3b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d3ba expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.700015:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000b6262ca0/0xcd11f61c1413d3b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d3ba expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664096.700121:0:7441:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c42d99f800 from 1 10000000:01000000:0.0:1788664096.700126:0:7441:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788664096.700172:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 0000000038fa4207/0xcd11f61c1413d3c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.700181:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 0000000038fa4207/0xcd11f61c1413d3c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.700191:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 0000000038fa4207/0xcd11f61c1413d3c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664096.700212:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f6b5111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140374016:0@lo:101: 00000100:00100000:0.0:1788664096.700525:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664096.700571:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aea2e1dd going to sleep for 11 seconds 00000100:00100000:2.0:1788664096.700885:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140374016 00000100:00100000:2.0:1788664096.700899:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140374016 00000100:00100000:2.0:1788664096.701091:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788664096.701101:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1f8bc07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+13:7441:x1875550140374016:12345-0@lo:101: 00010000:00010000:2.0:1788664096.701115:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664096.701126:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004da089db/0xcd11f61c1413d3cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d3c8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.701148:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004da089db/0xcd11f61c1413d3cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d3c8 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.701157:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004da089db/0xcd11f61c1413d3cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d3c8 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.701165:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004da089db, rc 0) 00000100:00100000:2.0:1788664096.702103:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1f8bc07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+14:7441:x1875550140374016:12345-0@lo:101: Request processed in 1001us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664096.702113:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788664096.705937:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f6b5111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140374016:0@lo:101: 00010000:00010000:0.0:1788664096.705976:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 0000000038fa4207/0xcd11f61c1413d3c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d3cf expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788664096.705981:0:6516:0:(import.c:65:import_set_state_nolock()) 000000009ec6b0f3 : changing import state from RECOVER to FULL 00010000:00010000:0.0:1788664096.705992:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 0000000038fa4207/0xcd11f61c1413d3c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d3cf expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664096.706069:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017362a6f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1875550140373504:12345-0@lo:38: Request processed in 10875us (12590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664096.706080:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664096.706273:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664096.706281:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788664096.706288:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788664096.706293:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788664096.706296:0:3635:0:(import.c:65:import_set_state_nolock()) 0000000039314396 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788664096.706310:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075d376cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140373504:0@lo:38: 00000100:00100000:2.0:1788664096.706416:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000012afddfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140374144:0@lo:41: 00000100:00100000:2.0:1788664096.706457:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664096.706632:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140374144 00000100:00100000:3.0:1788664096.706639:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140374144 00000100:00100000:3.0:1788664096.706686:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664096.706694:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c66796b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1875550140374144:12345-0@lo:41: 00000004:00000024:3.0:1788664096.706720:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788664096.706768:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c66796b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1875550140374144:12345-0@lo:41: Request processed in 74us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664096.706804:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788664096.706982:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000012afddfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140374144:0@lo:41: 00000100:00100000:2.0:1788664096.709973:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1a3e6cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140374272:0@lo:501: 00000100:00100000:2.0:1788664096.710037:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664096.710080:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c3de6182 going to sleep for 11 seconds 00000100:00100000:1.0:1788664096.710618:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140374272 00000100:00100000:1.0:1788664096.710626:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140374272 00000100:00100000:1.0:1788664096.710674:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788664096.710682:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006df446bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+14:7441:x1875550140374272:12345-0@lo:501: 00000100:00100000:1.0:1788664096.710850:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006df446bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+14:7441:x1875550140374272:12345-0@lo:501: Request processed in 169us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664096.710859:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788664096.711010:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1a3e6cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140374272:0@lo:501: 00000100:00100000:2.0:1788664096.711048:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1a3e6cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140374400:0@lo:503: 00000100:00100000:2.0:1788664096.711100:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664096.711170:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c3de6182 going to sleep for 11 seconds 00000100:00100000:3.0:1788664096.716334:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140374400 00000100:00100000:3.0:1788664096.716350:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140374400 00000100:00100000:3.0:1788664096.716476:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788664096.716485:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd9050be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+14:7441:x1875550140374400:12345-0@lo:503: 00000040:00080000:3.0:1788664096.716550:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788664096.716645:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd9050be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+14:7441:x1875550140374400:12345-0@lo:503: Request processed in 161us (5545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664096.717277:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1a3e6cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140374400:0@lo:503: 00000040:00080000:2.0:1788664096.717638:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788664096.717700:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1788664096.717800:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788664096.718038:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:2.0:1788664096.718652:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1788664096.720340:0:7441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788664096.720381:0:7441:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788664096.720405:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 0000000038fa4207/0xcd11f61c1413d3c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d3cf expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.720417:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 0000000038fa4207/0xcd11f61c1413d3c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d3cf expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664096.720484:0:7441:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788664096.720487:0:7441:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff93c42d99f800 10000000:01000000:0.0:1788664096.720490:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c42d99f800 10000000:01000000:0.0:1788664096.720504:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788664096.720510:0:7441:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c42d99f800 from 1 10000000:01000000:0.0:1788664096.720513:0:7441:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788664096.720544:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000928560a5/0xcd11f61c1413d3d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.720553:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000928560a5/0xcd11f61c1413d3d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.720572:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000928560a5/0xcd11f61c1413d3d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664096.720594:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f6b5111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140374528:0@lo:101: 00000100:00100000:0.0:1788664096.720655:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664096.720695:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d10a4e64 going to sleep for 11 seconds 00000100:00100000:3.0:1788664096.720834:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140374528 00000100:00100000:3.0:1788664096.720840:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140374528 00000100:00100000:3.0:1788664096.720987:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788664096.720996:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e8d13be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+14:7441:x1875550140374528:12345-0@lo:101: 00010000:00010000:3.0:1788664096.721008:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664096.721019:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a8b3ca3e/0xcd11f61c1413d3dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d3d6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.721047:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8b3ca3e/0xcd11f61c1413d3dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d3d6 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.721057:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a8b3ca3e/0xcd11f61c1413d3dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d3d6 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664096.721064:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a8b3ca3e, rc 0) 00000100:00100000:3.0:1788664096.721118:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e8d13be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:7441:x1875550140374528:12345-0@lo:101: Request processed in 123us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664096.721125:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788664096.721644:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f6b5111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140374528:0@lo:101: 00010000:00010000:0.0:1788664096.721660:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000928560a5/0xcd11f61c1413d3d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d3dd expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.721668:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000928560a5/0xcd11f61c1413d3d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d3dd expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664096.721760:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f6b5111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140374656:0@lo:501: 00000100:00100000:0.0:1788664096.721834:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664096.721855:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d10a4e64 going to sleep for 11 seconds 00000100:00100000:1.0:1788664096.721908:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140374656 00000100:00100000:1.0:1788664096.721922:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140374656 00000100:00100000:1.0:1788664096.721978:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788664096.721985:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f11d7bc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:7441:x1875550140374656:12345-0@lo:501: 00000100:00100000:1.0:1788664096.722089:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f11d7bc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:7441:x1875550140374656:12345-0@lo:501: Request processed in 104us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664096.722097:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788664096.722222:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f6b5111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140374656:0@lo:501: 00000100:00100000:0.0:1788664096.722249:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f6b5111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140374784:0@lo:503: 00000100:00100000:0.0:1788664096.722287:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664096.722312:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d10a4e64 going to sleep for 11 seconds 00000100:00100000:2.0:1788664096.722375:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140374784 00000100:00100000:2.0:1788664096.722380:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140374784 00000100:00100000:2.0:1788664096.722412:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788664096.722419:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a80b6c98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:7441:x1875550140374784:12345-0@lo:503: 00000100:00100000:2.0:1788664096.722502:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a80b6c98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:7441:x1875550140374784:12345-0@lo:503: Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664096.722509:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788664096.722579:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f6b5111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140374784:0@lo:503: 00000040:00080000:0.0:1788664096.722863:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788664096.722953:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f6b5111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140374912:0@lo:502: 00000100:00100000:0.0:1788664096.722997:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664096.723019:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d10a4e64 going to sleep for 11 seconds 00000100:00100000:2.0:1788664096.723296:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140374912 00000100:00100000:2.0:1788664096.723301:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140374912 00000100:00100000:2.0:1788664096.723324:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788664096.723330:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb876412 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:7441:x1875550140374912:12345-0@lo:502: 00000100:00100000:2.0:1788664096.723415:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb876412 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:7441:x1875550140374912:12345-0@lo:502: Request processed in 85us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664096.723422:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788664096.723740:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f6b5111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140374912:0@lo:502: 00000040:00080000:1.0:1788664096.733139:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788664096.733203:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788664096.733222:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788664096.733238:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788664096.733250:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788664096.733263:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788664096.733276:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788664096.733289:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788664096.733303:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788664096.733317:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788664096.733333:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788664096.733348:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788664096.733363:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788664096.733378:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788664096.733394:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788664096.733408:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788664096.733423:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788664096.733435:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788664096.733447:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788664096.733458:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788664096.733472:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788664096.733485:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788664096.733499:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788664096.733511:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788664096.733524:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788664096.733548:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788664096.733560:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788664096.733573:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1788664096.733632:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140375040:0@lo:502: 00000100:00100000:1.0:1788664096.733715:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664096.735339:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fefbbd75 going to sleep for 11 seconds 00000100:00100000:2.0:1788664096.742228:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140375040 00000100:00100000:2.0:1788664096.742245:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140375040 00000100:00100000:2.0:1788664096.742310:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788664096.742320:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001778df65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:7441:x1875550140375040:12345-0@lo:502: 00000100:00100000:2.0:1788664096.742495:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001778df65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:7441:x1875550140375040:12345-0@lo:502: Request processed in 176us (8780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664096.742512:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788664096.742684:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008684162f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140375040:0@lo:502: 00000040:00080000:3.0:1788664096.742812:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788664096.742825:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788664096.745222:0:7460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788664096.745239:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000005224599a) 00000020:00000080:3.0:1788664096.745262:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788664096.745563:0:7460:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000b8730be from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788664096.745568:0:7460:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000b8730be from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788664096.745571:0:7460:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000b8730be 3 00010000:00080000:3.0:1788664096.745602:0:7460:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000092de95aa@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788664096.749855:0:7460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1788664096.751404:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788664096.751448:0:7460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788664096.751461:0:7460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xcd11f61c1413d3eb 00000100:00080000:3.0:1788664096.751472:0:7460:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788664096.751477:0:7460:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000092de95aa using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788664096.751511:0:7460:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000023fca439 x1875550140375168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788664096.751544:0:7460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788664096.752926:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023fca439 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875550140375168:0@lo:38: 00000100:00100000:2.0:1788664096.753023:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664096.753238:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140375168 00000100:00100000:3.0:1788664096.753246:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140375168 00000100:00100000:3.0:1788664096.753288:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664096.753295:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1a3e6cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1875550140375168:12345-0@lo:38: 00010000:00080000:3.0:1788664096.753322:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:3.0:1788664096.753356:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcd11f61c1413d3f2 00000004:00100000:3.0:1788664096.753371:0:6511:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788664096.753401:0:6511:0:(import.c:65:import_set_state_nolock()) 000000002a57ffc1 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664096.753457:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1a3e6cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875550140375168:12345-0@lo:38: Request processed in 161us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664096.753479:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788664096.753567:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000023fca439 x1875550140375168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664096.753579:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788664096.753587:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788664096.753593:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788664096.753597:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788664096.753599:0:3635:0:(import.c:65:import_set_state_nolock()) 0000000092de95aa lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788664096.753604:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023fca439 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875550140375168:0@lo:38: 00000040:00080000:0.0:1788664096.763489:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1788664096.763683:0:7461:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:1.0:1788664096.763875:0:7441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788664096.763902:0:7441:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788664096.763920:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000928560a5/0xcd11f61c1413d3d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d3dd expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.763934:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000928560a5/0xcd11f61c1413d3d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d3dd expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788664096.763997:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788664096.763999:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788664096.764001:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664096.764002:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664096.764004:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664096.764005:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664096.764006:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788664096.764007:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788664096.764009:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788664096.764010:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664096.764012:0:7441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788664096.764015:0:7441:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1788664096.764018:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788664096.764019:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788664096.764020:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664096.764021:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664096.764022:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664096.764024:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664096.764024:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788664096.764025:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788664096.764026:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788664096.764027:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664096.764033:0:7441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788664096.764059:0:7441:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788664096.764077:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041743e38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140375296:0@lo:253: 00000100:00100000:1.0:1788664096.764153:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664096.764190:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b36c5a50 going to sleep for 11 seconds 00000100:00100000:0.0:1788664096.764636:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140375296 00000100:00100000:0.0:1788664096.764644:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140375296 00000100:00100000:0.0:1788664096.766187:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788664096.766203:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab53a769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:7441:x1875550140375296:12345-0@lo:253: 20000000:01000000:0.0:1788664096.766236:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788664096.766248:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788664096.770110:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788664096.770180:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788664096.770198:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788664096.770406:0:6527:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788664096.770412:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788664096.770430:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000090af938b/0xcd11f61c1413d3f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.770448:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005a181e7a/0xcd11f61c1413d312 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d30b expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.770461:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000011097d49/0xcd11f61c1413d3ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d3b3 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.770468:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000090af938b/0xcd11f61c1413d3f9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.770506:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000011097d49/0xcd11f61c1413d3ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d3b3 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.770518:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000011097d49/0xcd11f61c1413d3ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d3b3 expref: 15 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664096.770531:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ebf63c82 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875550140375424:0@lo:104: 00000100:00100000:1.0:1788664096.770591:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664096.770643:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005a181e7a/0xcd11f61c1413d312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d30b expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.770651:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005a181e7a/0xcd11f61c1413d312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d30b expref: 15 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664096.770676:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3d830e1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875550140375552:0@lo:104: 00000100:00100000:1.0:1788664096.770701:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664096.770726:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c5fc2e96 going to sleep for 11 seconds 00000100:00100000:2.0:1788664096.770831:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140375424 00000100:00100000:2.0:1788664096.770839:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140375424 00000100:00100000:2.0:1788664096.770870:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140375552 00000100:00100000:2.0:1788664096.770872:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140375552 00000100:00100000:2.0:1788664096.770883:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788664096.770890:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052500488 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+4:6527:x1875550140375424:12345-0@lo:104: 00010000:00010000:2.0:1788664096.770901:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000b6262ca0/0xcd11f61c1413d3b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d3ba expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.770970:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664096.770975:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052500488 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+4:6527:x1875550140375424:12345-0@lo:104: Request processed in 86us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664096.770982:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788664096.770998:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788664096.771010:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c884d410 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+3:6527:x1875550140375552:12345-0@lo:104: 00010000:00010000:2.0:1788664096.771017:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d30b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d312 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664096.771048:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788664096.771051:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c884d410 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+3:6527:x1875550140375552:12345-0@lo:104: Request processed in 44us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664096.771057:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788664096.771642:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ebf63c82 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875550140375424:0@lo:104: 00000100:00100000:1.0:1788664096.771652:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3d830e1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875550140375552:0@lo:104: 00010000:00010000:1.0:1788664096.771671:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000090af938b/0xcd11f61c1413d3f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.771843:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664096.771850:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000b6262ca0/0xcd11f61c1413d3b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d3ba expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.771858:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b6262ca0 already unused, calling callback (00000000b4c0f7fd) 10000000:00010000:0.0:1788664096.771861:0:7453:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000b6262ca0/0xcd11f61c1413d3b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d3ba expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.771867:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000b6262ca0/0xcd11f61c1413d3b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d3ba expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664096.771874:0:7453:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000b6262ca0/0xcd11f61c1413d3b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d3ba expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664096.771892:0:7453:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664096.771924:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000b6262ca0/0xcd11f61c1413d3b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d3ba expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.771931:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664096.771951:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000b6262ca0/0xcd11f61c1413d3b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d3ba expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.771957:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000b6262ca0/0xcd11f61c1413d3b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d3ba expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.771984:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664096.771987:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d30b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d312 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.771993:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e3b0710a already unused, calling callback (00000000b4c0f7fd) 10000000:00010000:0.0:1788664096.771995:0:7453:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d30b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d312 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.772000:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d30b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d312 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664096.772006:0:7453:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d30b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d312 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664096.772011:0:7453:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664096.772022:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d30b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d312 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.772027:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664096.772043:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d30b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d312 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.772049:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000e3b0710a/0xcd11f61c1413d30b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d312 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664096.772062:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664096.772063:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664096.772065:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664096.772071:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664096.772384:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab53a769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:7441:x1875550140375296:12345-0@lo:253: Request processed in 6186us (8231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664096.772395:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788664096.772478:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081414b3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140375808:0@lo:103: 00000100:00100000:1.0:1788664096.772510:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664096.772557:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f6b5111 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140375680:0@lo:103: 00000100:00100000:1.0:1788664096.772582:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664096.772611:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140375808 00000100:00100000:1.0:1788664096.772617:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140375808 00010000:00010000:1.0:1788664096.772635:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005a181e7a/0xcd11f61c1413d312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d30b expref: 15 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664096.772657:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140375680 00000100:00100000:1.0:1788664096.772661:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140375680 00010000:00010000:1.0:1788664096.772671:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000011097d49/0xcd11f61c1413d3ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d3b3 expref: 16 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664096.772684:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788664096.772691:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3d830e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+16:3636:x1875550140375808:12345-0@lo:103: 00010000:00010000:1.0:1788664096.772702:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664096.772707:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005a181e7a/0xcd11f61c1413d312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d30b expref: 16 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.772723:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005a181e7a/0xcd11f61c1413d312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d30b expref: 16 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.772735:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005a181e7a/0xcd11f61c1413d312 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d30b expref: 16 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.772746:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664096.772978:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3d830e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+15:3636:x1875550140375808:12345-0@lo:103: Request processed in 287us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664096.772985:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788664096.772999:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788664096.773005:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000dd53090 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+14:3639:x1875550140375680:12345-0@lo:103: 00010000:00010000:1.0:1788664096.773013:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664096.773017:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000011097d49/0xcd11f61c1413d3ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d3b3 expref: 14 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.773024:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000011097d49/0xcd11f61c1413d3ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d3b3 expref: 14 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.773033:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000011097d49/0xcd11f61c1413d3ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d3b3 expref: 14 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.773043:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000090af938b/0xcd11f61c1413d3f9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.773050:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000090af938b/0xcd11f61c1413d3f9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788664096.773062:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002651964s 00010000:00010000:1.0:1788664096.773075:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000090af938b/0xcd11f61c1413d3f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.773080:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000090af938b/0xcd11f61c1413d3f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.773085:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000090af938b/0xcd11f61c1413d3f9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.773090:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000090af938b/0xcd11f61c1413d3f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.773094:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000090af938b already unused, calling callback (0000000001315907) 00010000:00010000:1.0:1788664096.773098:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000090af938b/0xcd11f61c1413d3f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.773103:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000090af938b/0xcd11f61c1413d3f9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.773116:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000090af938b/0xcd11f61c1413d3f9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.773124:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664096.773152:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000dd53090 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+13:3639:x1875550140375680:12345-0@lo:103: Request processed in 147us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664096.773158:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788664096.773210:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f6b5111 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140375680:0@lo:103: 00000100:00100000:1.0:1788664096.773234:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081414b3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140375808:0@lo:103: 00010000:00010000:1.0:1788664096.773255:0:6527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000090af938b/0xcd11f61c1413d3f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.773274:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000090af938b/0xcd11f61c1413d3f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664096.773280:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000090af938b/0xcd11f61c1413d3f9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664096.773500:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041743e38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:7441:1875550140375296:0@lo:253: 10000000:01000000:0.0:1788664096.773512:0:7441:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788664096.773515:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788664096.773517:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788664096.773518:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664096.773519:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788664096.773520:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664096.773522:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664096.773523:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788664096.773524:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788664096.773526:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788664096.773527:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664096.773528:0:7441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788664096.773538:0:7441:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788664096.780476:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1788664096.780658:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788664096.780862:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788664096.781020:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788664096.781213:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788664096.781366:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788664096.781737:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788664096.784215:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788664096.784538:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1788664096.785048:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788664096.785250:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1788664096.785429:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1788664096.787184:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1788664096.787437:0:7466:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1788664096.787493:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dfdf8b15 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1875550140375936:0@lo:700: 00000100:00100000:0.0:1788664096.787560:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664096.787606:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140375936 00000100:00100000:0.0:1788664096.787612:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140375936 00000100:00100000:0.0:1788664096.787651:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664096.787659:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b26fc0ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1875550140375936:12345-0@lo:700: 00000040:01000000:2.0:1788664096.787891:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788664096.788160:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 0000000007808e2d going to sleep for 11 seconds 00000020:00080000:1.0:1788664096.788214:0:7465:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788664096.788217:0:7465:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788664096.788477:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875550140376064:0@lo:1000: 00000100:00100000:3.0:1788664096.788524:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664096.788559:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017dfdb83 going to sleep for 11 seconds 00000100:00100000:1.0:1788664096.788615:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140376064 00000100:00100000:1.0:1788664096.788621:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140376064 00000100:00100000:1.0:1788664096.788660:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788664096.788666:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016f5d9b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1875550140376064:12345-0@lo:1000: 00000100:00100000:1.0:1788664096.788745:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016f5d9b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1875550140376064:12345-0@lo:1000: Request processed in 68us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664096.788753:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:2.0:1788664096.789351:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788664096.789451:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788664096.790481:0:7441:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788664096.790494:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788664096.790671:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788664096.790978:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875550140376064:0@lo:1000: 00000040:01000000:3.0:1788664096.791022:0:7467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1788664096.791061:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875550140376192:0@lo:700: 00000100:00100000:3.0:1788664096.791113:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664096.791158:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d43725a2 going to sleep for 11 seconds 00000100:00100000:1.0:1788664096.791248:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140376192 00000100:00100000:1.0:1788664096.791254:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140376192 00000100:00100000:1.0:1788664096.791296:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664096.791305:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000845f093f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1875550140376192:12345-0@lo:700: 00000100:00100000:1.0:1788664096.791364:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000845f093f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1875550140376192:12345-0@lo:700: Request processed in 59us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664096.791371:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788664096.792098:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875550140376192:0@lo:700: 00000100:00100000:3.0:1788664096.792160:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1875550140376320:0@lo:900: 00000100:00100000:3.0:1788664096.792198:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664096.792225:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d43725a2 going to sleep for 11 seconds 00000100:00100000:1.0:1788664096.792321:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140376320 00000100:00100000:1.0:1788664096.792326:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140376320 00000100:00100000:1.0:1788664096.792354:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664096.792361:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007296c715 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1875550140376320:12345-0@lo:900: 00000100:00100000:1.0:1788664096.792400:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007296c715 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1875550140376320:12345-0@lo:900: Request processed in 40us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664096.792418:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788664096.792488:0:7467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001acb238c x1875550140376320/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788664112 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664096.792499:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1875550140376320:0@lo:900: 00000100:00100000:3.0:1788664096.792561:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875550140376448:0@lo:1000: 00000100:00100000:3.0:1788664096.792599:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664096.792622:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e874251d going to sleep for 11 seconds 00000100:00100000:1.0:1788664096.792669:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140376448 00000100:00100000:1.0:1788664096.792674:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140376448 00000100:00100000:1.0:1788664096.792704:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788664096.792710:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009de88d77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1875550140376448:12345-0@lo:1000: 00000100:00100000:1.0:1788664096.792767:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009de88d77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1875550140376448:12345-0@lo:1000: Request processed in 57us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664096.792789:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788664096.792905:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875550140376448:0@lo:1000: 00000004:00080000:3.0:1788664096.792956:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000d43725a2 with version 0 00000020:00100000:3.0:1788664096.792980:0:7467:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788664096.792985:0:7467:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001acb238c x1875550140376704/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788664096.792996:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875550140376704:0@lo:1000: 00000100:00100000:3.0:1788664096.793019:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664096.793044:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 000000003777239e going to sleep for 11 seconds 00000040:00080000:2.0:1788664096.793756:0:7441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788664096.794400:0:7441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788664096.794437:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788664096.794653:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788664096.795109:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140376704 00000100:00100000:1.0:1788664096.795119:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140376704 00000100:00100000:1.0:1788664096.795168:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788664096.795177:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008da3dcda pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1875550140376704:12345-0@lo:1000: 00080000:10000000:2.0:1788664096.796528:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000001:00080000:3.0:1788664096.797834:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1788664096.798078:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008da3dcda pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1875550140376704:12345-0@lo:1000: Request processed in 2899us (5055us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788664096.798094:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 40000000:02000000:1.0:1788664096.798181:0:6518:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000004:00080000:3.0:1788664096.798994:0:7467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788664096.799003:0:7467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788664096.799020:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875550140376704:0@lo:1000: 00000100:00100000:3.0:1788664096.799130:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875550140376832:0@lo:1000: 00000100:00100000:3.0:1788664096.799183:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664096.799236:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017dfdb83 going to sleep for 11 seconds 00000100:00100000:0.0:1788664096.799301:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140376832 00000100:00100000:0.0:1788664096.799309:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140376832 00000100:00100000:0.0:1788664096.799350:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788664096.799357:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005aa48902 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1875550140376832:12345-0@lo:1000: 00000100:00100000:0.0:1788664096.799449:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005aa48902 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1875550140376832:12345-0@lo:1000: Request processed in 92us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664096.799457:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664096.799921:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875550140376832:0@lo:1000: 00000040:00080000:3.0:1788664096.799944:0:7467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788664096.799988:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000d43725a2 with version 1 00000040:00080000:3.0:1788664096.806225:0:7467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788664096.806325:0:7467:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788664096.806534:0:7457:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000a7d66dea version 1 rpc_version 1 00000020:00100000:0.0:1788664096.806574:0:7457:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788664096.806583:0:7457:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001af71e8a x1875550140377088/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788664096.806605:0:7457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001af71e8a pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7457:1875550140377088:0@lo:1000: 00000100:00100000:0.0:1788664096.806687:0:7457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664096.806733:0:7457:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c939520 going to sleep for 11 seconds 00100000:10000000:0.0:1788664096.807397:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788664096.807566:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788664096.807702:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788664096.807864:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788664096.808067:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788664096.808289:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788664096.808421:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788664096.808548:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788664096.808708:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788664096.808871:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788664096.809011:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788664096.809139:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788664096.809290:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788664096.809433:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788664096.809562:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788664096.809701:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000100:00100000:3.0:1788664096.810227:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140377088 00000100:00100000:3.0:1788664096.810239:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140377088 00000100:00100000:3.0:1788664096.810334:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664096.810343:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e037cac6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7457:x1875550140377088:12345-0@lo:1000: 00100000:10000000:0.0:1788664096.812511:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788664096.812697:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788664096.813032:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788664096.813152:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788664096.813296:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788664096.813410:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788664096.813531:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788664096.813727:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00000100:00100000:1.0:1788664096.813980:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b26fc0ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1875550140375936:12345-0@lo:700: Request processed in 26318us (26417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664096.813997:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788664096.814063:0:7466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dfdf8b15 x1875550140375936/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788664112 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664096.814078:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dfdf8b15 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1875550140375936:0@lo:700: 40000000:02000000:1.0:1788664096.814092:0:7466:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:0.0:1788664096.816642:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788664096.816847:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788664096.816990:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788664096.817149:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788664096.817279:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788664096.819087:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788664096.819986:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788664096.820153:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788664096.822187:0:7441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788664096.826021:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1788664096.827911:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e037cac6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7457:x1875550140377088:12345-0@lo:1000: Request processed in 17563us (21217us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788664096.827927:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00080000:2.0:1788664096.829648:0:7441:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788664096.829686:0:7441:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaa6d41c7b988 00100000:10000000:2.0:1788664096.829694:0:7441:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788664096.830204:0:7441:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788664096.830249:0:7441:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788664096.830268:0:7441:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788664096.830302:0:7441:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788664096.831061:0:7441:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788664096.831250:0:7441:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=41009432 00000004:00080000:0.0:1788664096.842468:0:7457:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788664096.842478:0:7457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788664096.842501:0:7457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001af71e8a pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7457:1875550140377088:0@lo:1000: 00000040:00080000:0.0:1788664096.869065:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788664096.886966:0:7466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788664096.887062:0:7466:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788664096.887067:0:7466:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1788664097.214130:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664098.237909:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664099.262098:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664100.285908:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664101.312541:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788664101.625602:0:7711:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788664101.956894:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140377216:0@lo:41: 00000100:00100000:3.0:1788664101.957049:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664101.957203:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140377216 00000100:00100000:2.0:1788664101.957212:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140377216 00000100:00100000:2.0:1788664101.957288:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788664101.957297:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6cb5a7e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140377216:12345-0@lo:41: 00000004:00000024:2.0:1788664101.957337:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788664101.957392:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6cb5a7e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140377216:12345-0@lo:41: Request processed in 97us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664101.957399:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788664101.957444:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140377216:0@lo:41: 00000100:00100000:0.0:1788664101.958967:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001af71e8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140377344:0@lo:400: 00000100:00100000:0.0:1788664101.959028:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664101.959071:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664101.959077:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1850496 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140377472:0@lo:400: 00000100:00100000:0.0:1788664101.959103:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664101.959130:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f66fe32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140377600:0@lo:400: 00000100:00100000:0.0:1788664101.959152:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664101.959180:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140377344 00000100:00100000:0.0:1788664101.959187:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140377344 00000100:00100000:0.0:1788664101.959223:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788664101.959240:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1305bd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+13:3638:x1875550140377344:12345-0@lo:400: 00000100:00100000:0.0:1788664101.959286:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1305bd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+13:3638:x1875550140377344:12345-0@lo:400: Request processed in 48us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664101.959294:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788664101.959326:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140377472 00000100:00100000:0.0:1788664101.959330:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140377472 00000100:00100000:0.0:1788664101.959353:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140377600 00000100:00100000:0.0:1788664101.959356:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140377600 00000100:00100000:0.0:1788664101.959368:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664101.959373:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000681ec79e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140377472:12345-0@lo:400: 00000100:00100000:0.0:1788664101.959402:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000681ec79e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140377472:12345-0@lo:400: Request processed in 30us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664101.959408:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664101.959418:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788664101.959423:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfdf8b15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140377600:12345-0@lo:400: 00000100:00100000:0.0:1788664101.959451:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfdf8b15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140377600:12345-0@lo:400: Request processed in 27us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664101.959456:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788664101.959494:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000f66fe32 x1875550140377600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664101.959508:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f66fe32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140377600:0@lo:400: 00010000:00080000:0.0:1788664101.959531:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a1850496 x1875550140377472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664101.959539:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1850496 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140377472:0@lo:400: 00000100:00100000:0.0:1788664101.959547:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001af71e8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140377344:0@lo:400: 00010000:00010000:0.0:1788664102.336036:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788664102.785093:0:7764:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788664102.788219:0:7764:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788664103.357883:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664104.382891:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664105.408965:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788664105.535236:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788664105.535244:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c42d99f800 from 4 10000000:01000000:0.0:1788664105.535249:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788664105.535290:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000694f3a1f/0xcd11f61c1413d400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664105.535303:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000694f3a1f/0xcd11f61c1413d400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664105.535313:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000694f3a1f/0xcd11f61c1413d400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664105.535338:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001af71e8a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140377728:0@lo:101: 00000100:00100000:0.0:1788664105.535406:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664105.535492:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cfdc3b7e going to sleep for 11 seconds 00000100:00100000:3.0:1788664105.546117:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140377728 00000100:00100000:3.0:1788664105.546133:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140377728 00000100:00100000:3.0:1788664105.546209:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788664105.546217:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed738155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+13:6508:x1875550140377728:12345-0@lo:101: 00010000:00010000:3.0:1788664105.546237:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664105.546257:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b6262ca0/0xcd11f61c1413d407 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d400 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.546286:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b6262ca0/0xcd11f61c1413d407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d400 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.546297:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b6262ca0/0xcd11f61c1413d407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d400 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.546306:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b6262ca0, rc 0) 00000100:00100000:3.0:1788664105.546386:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed738155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+14:6508:x1875550140377728:12345-0@lo:101: Request processed in 169us (10981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664105.546392:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788664105.546476:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001af71e8a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140377728:0@lo:101: 00010000:00010000:2.0:1788664105.546493:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000694f3a1f/0xcd11f61c1413d400 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664105.546502:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000694f3a1f/0xcd11f61c1413d400 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664105.546569:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ae525ad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140377856:0@lo:256: 00000100:00100000:2.0:1788664105.546623:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664105.546660:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7dc8fc2 going to sleep for 11 seconds 00000100:00100000:3.0:1788664105.546820:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140377856 00000100:00100000:3.0:1788664105.546825:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140377856 00000100:00100000:3.0:1788664105.546852:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788664105.546857:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bd6d7e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+14:6508:x1875550140377856:12345-0@lo:256: 20000000:01000000:3.0:1788664105.546880:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788664105.546895:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788664105.546898:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788664105.546985:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bd6d7e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+14:6508:x1875550140377856:12345-0@lo:256: Request processed in 128us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664105.546992:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788664105.547022:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ae525ad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140377856:0@lo:256: 10000000:01000000:3.0:1788664105.547058:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788664105.547064:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000694f3a1f/0xcd11f61c1413d400 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.547071:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000694f3a1f/0xcd11f61c1413d400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664105.547081:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788664105.547083:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c40641a800 from 21 10000000:01000000:3.0:1788664105.547086:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788664105.547102:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 0000000011e60adb/0xcd11f61c1413d40e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.547109:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 0000000011e60adb/0xcd11f61c1413d40e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.547115:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 0000000011e60adb/0xcd11f61c1413d40e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664105.547126:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140377984:0@lo:101: 00000100:00100000:3.0:1788664105.547161:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664105.547175:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d6cabeac going to sleep for 11 seconds 00000100:00100000:3.0:1788664105.547189:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140377984 00000100:00100000:3.0:1788664105.547192:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140377984 00000100:00100000:3.0:1788664105.547211:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788664105.547215:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041443927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+14:6508:x1875550140377984:12345-0@lo:101: 00010000:00010000:3.0:1788664105.547222:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664105.547229:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bfde98bf/0xcd11f61c1413d415 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d40e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.547241:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bfde98bf/0xcd11f61c1413d415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d40e expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.547248:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bfde98bf/0xcd11f61c1413d415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d40e expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.547254:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bfde98bf, rc 0) 00000100:00100000:3.0:1788664105.547279:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041443927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140377984:12345-0@lo:101: Request processed in 64us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664105.547284:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788664105.547311:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140377984:0@lo:101: 00010000:00010000:3.0:1788664105.547320:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 0000000011e60adb/0xcd11f61c1413d40e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d415 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.547326:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 0000000011e60adb/0xcd11f61c1413d40e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d415 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664105.547375:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140378112:0@lo:501: 00000100:00100000:3.0:1788664105.547396:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664105.547408:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d6cabeac going to sleep for 11 seconds 00000100:00100000:3.0:1788664105.547418:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140378112 00000100:00100000:3.0:1788664105.547428:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140378112 00000100:00100000:3.0:1788664105.547450:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788664105.547455:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ffb468 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140378112:12345-0@lo:501: 00000100:00100000:3.0:1788664105.547558:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ffb468 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140378112:12345-0@lo:501: Request processed in 103us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664105.547565:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788664105.547766:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140378112:0@lo:501: 00000100:00100000:3.0:1788664105.547834:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140378240:0@lo:503: 00000100:00100000:3.0:1788664105.547871:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664105.547886:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d6cabeac going to sleep for 11 seconds 00000100:00100000:2.0:1788664105.548208:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140378240 00000100:00100000:2.0:1788664105.548213:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140378240 00000100:00100000:2.0:1788664105.548236:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788664105.548241:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b472bca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140378240:12345-0@lo:503: 00000100:00100000:2.0:1788664105.548322:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b472bca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140378240:12345-0@lo:503: Request processed in 80us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664105.548328:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788664105.548461:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140378240:0@lo:503: 00000100:00100000:3.0:1788664105.550853:0:7852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:7852:1875550140378368:0@lo:502: 00000100:00100000:3.0:1788664105.550938:0:7852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664105.550978:0:7852:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e90ef206 going to sleep for 11 seconds 00000100:00100000:1.0:1788664105.552874:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140378368 00000100:00100000:1.0:1788664105.552888:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140378368 00000100:00100000:1.0:1788664105.552941:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788664105.552949:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb91061d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:7852:x1875550140378368:12345-0@lo:502: 00000100:00100000:1.0:1788664105.553100:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb91061d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:7852:x1875550140378368:12345-0@lo:502: Request processed in 151us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664105.553108:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788664105.553267:0:7852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:7852:1875550140378368:0@lo:502: 00000100:00100000:3.0:1788664105.553334:0:7852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:7852:1875550140378496:0@lo:502: 00000100:00100000:3.0:1788664105.553374:0:7852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664105.553403:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140378496 00000100:00100000:3.0:1788664105.553406:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140378496 00000100:00100000:3.0:1788664105.553429:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788664105.553435:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cac40acd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:7852:x1875550140378496:12345-0@lo:502: 00000100:00100000:3.0:1788664105.553497:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cac40acd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:7852:x1875550140378496:12345-0@lo:502: Request processed in 63us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664105.553504:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788664105.553540:0:7852:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e90ef206 going to sleep for 11 seconds 00000100:00100000:3.0:1788664105.553558:0:7852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:7852:1875550140378496:0@lo:502: 00000040:00080000:3.0:1788664105.553575:0:7852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788664105.553643:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788664105.553659:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788664105.553666:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 0000000011e60adb/0xcd11f61c1413d40e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d415 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.553675:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 0000000011e60adb/0xcd11f61c1413d40e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d415 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664105.553685:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788664105.553688:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c40641a800 from 4 10000000:01000000:3.0:1788664105.553691:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788664105.553711:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d41c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.553718:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d41c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.553725:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d41c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664105.553736:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140378624:0@lo:101: 00000100:00100000:3.0:1788664105.553761:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664105.553795:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e90ef206 going to sleep for 11 seconds 00000100:00100000:3.0:1788664105.553807:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140378624 00000100:00100000:3.0:1788664105.553811:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140378624 00000100:00100000:3.0:1788664105.553830:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788664105.553835:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7b93f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140378624:12345-0@lo:101: 00010000:00010000:3.0:1788664105.553844:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664105.553860:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004e1382f7/0xcd11f61c1413d423 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d41c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.553880:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004e1382f7/0xcd11f61c1413d423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d41c expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.553889:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004e1382f7/0xcd11f61c1413d423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d41c expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.553896:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004e1382f7, rc 0) 00000100:00100000:3.0:1788664105.553935:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7b93f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140378624:12345-0@lo:101: Request processed in 100us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664105.553941:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788664105.553968:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140378624:0@lo:101: 00010000:00010000:3.0:1788664105.553979:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d41c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d423 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.553987:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d41c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d423 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664105.554026:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140378752:0@lo:256: 00000100:00100000:3.0:1788664105.554055:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664105.554067:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e90ef206 going to sleep for 11 seconds 00000100:00100000:3.0:1788664105.554078:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140378752 00000100:00100000:3.0:1788664105.554080:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140378752 00000100:00100000:3.0:1788664105.554098:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788664105.554103:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e955726 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140378752:12345-0@lo:256: 20000000:01000000:3.0:1788664105.554114:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788664105.554128:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788664105.554134:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788664105.555008:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e955726 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140378752:12345-0@lo:256: Request processed in 902us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664105.555018:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788664105.555060:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140378752:0@lo:256: 10000000:01000000:3.0:1788664105.555098:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788664105.555104:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d41c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d423 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.555111:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 0000000079393a9f/0xcd11f61c1413d41c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d423 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664105.555118:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788664105.555119:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788664105.555122:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788664105.555140:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 000000004ee162a3/0xcd11f61c1413d42a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.555147:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 000000004ee162a3/0xcd11f61c1413d42a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.555226:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 000000004ee162a3/0xcd11f61c1413d42a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664105.555242:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140378880:0@lo:101: 00000100:00100000:3.0:1788664105.555268:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664105.555283:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e90ef206 going to sleep for 11 seconds 00000100:00100000:3.0:1788664105.555298:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140378880 00000100:00100000:3.0:1788664105.555302:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140378880 00000100:00100000:3.0:1788664105.555328:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788664105.555341:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5ba409a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140378880:12345-0@lo:101: 00010000:00010000:3.0:1788664105.555351:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664105.555372:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006779304c/0xcd11f61c1413d431 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d42a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.555389:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006779304c/0xcd11f61c1413d431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d42a expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.555397:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006779304c/0xcd11f61c1413d431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d42a expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.555404:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006779304c, rc 0) 00000100:00100000:3.0:1788664105.555431:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5ba409a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140378880:12345-0@lo:101: Request processed in 91us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664105.555437:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788664105.555463:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140378880:0@lo:101: 00010000:00010000:3.0:1788664105.555473:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 000000004ee162a3/0xcd11f61c1413d42a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d431 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.555481:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 000000004ee162a3/0xcd11f61c1413d42a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d431 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664105.555527:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140379008:0@lo:501: 00000100:00100000:3.0:1788664105.555550:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664105.555562:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e90ef206 going to sleep for 11 seconds 00000100:00100000:3.0:1788664105.555573:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140379008 00000100:00100000:3.0:1788664105.555576:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140379008 00000100:00100000:3.0:1788664105.555596:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788664105.555601:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d527970 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140379008:12345-0@lo:501: 00000100:00100000:3.0:1788664105.555709:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d527970 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140379008:12345-0@lo:501: Request processed in 107us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664105.555715:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788664105.555741:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140379008:0@lo:501: 00000100:00100000:3.0:1788664105.555762:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140379136:0@lo:503: 00000100:00100000:3.0:1788664105.556228:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664105.556388:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e90ef206 going to sleep for 11 seconds 00000100:00100000:2.0:1788664105.566120:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140379136 00000100:00100000:2.0:1788664105.566139:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140379136 00000100:00100000:2.0:1788664105.566260:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788664105.566282:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f01a9e0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140379136:12345-0@lo:503: 00000100:00100000:2.0:1788664105.566452:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f01a9e0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140379136:12345-0@lo:503: Request processed in 171us (10224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664105.566460:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788664105.566532:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140379136:0@lo:503: 00000100:00100000:2.0:1788664105.566760:0:7854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008364e9e6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:7854:1875550140379264:0@lo:502: 00000100:00100000:2.0:1788664105.566820:0:7854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664105.566846:0:7854:0:(client.c:2716:ptlrpc_set_wait()) set 00000000609a7409 going to sleep for 11 seconds 00000100:00100000:0.0:1788664105.566922:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140379264 00000100:00100000:0.0:1788664105.566926:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140379264 00000100:00100000:0.0:1788664105.566947:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788664105.566952:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005f2b343 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:7854:x1875550140379264:12345-0@lo:502: 00000100:00100000:0.0:1788664105.567027:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005f2b343 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:7854:x1875550140379264:12345-0@lo:502: Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664105.567034:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788664105.567116:0:7854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008364e9e6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:7854:1875550140379264:0@lo:502: 00000020:01000000:2.0:1788664105.567135:0:7854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664105.567146:0:7854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664105.567148:0:7854:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788664105.567214:0:7854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788664105.567218:0:7854:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:00000080:2.0:1788664105.567237:0:7854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788664105.567249:0:7854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000b03a3326) 00000020:00000080:2.0:1788664105.567268:0:7854:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1788664105.567272:0:7854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788664105.567340:0:7854:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788664105.567345:0:7854:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788664105.567352:0:7854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413d43f 00010000:00080000:2.0:1788664105.567377:0:7854:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000eb343cde@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788664105.570834:0:7854:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1788664105.582237:0:7854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788664105.582254:0:7854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788664105.582290:0:7854:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788664105.582313:0:7854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd11f61c1413d446 00000100:00080000:3.0:1788664105.582323:0:7854:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788664105.582328:0:7854:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000eb343cde using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788664105.582359:0:7854:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b5614dc5 x1875550140379392/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664105.582409:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140379392:0@lo:38: 00000100:00100000:2.0:1788664105.582491:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788664105.582550:0:7854:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1788664105.582589:0:7854:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1788664105.586700:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ceebe604 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140379520:0@lo:400: 00000100:00080000:1.0:1788664105.587067:0:7859:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000ebf63c82 x1875550140379904/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664105.587080:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set 000000006585432e going to sleep for 0 seconds 00000020:01000000:3.0:1788664105.587185:0:7854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664105.587191:0:7854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664105.587194:0:7854:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788664105.587196:0:7854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664105.587201:0:7854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664105.587202:0:7854:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788664105.587204:0:7854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788664105.587206:0:7854:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788664105.587225:0:7854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:7854:1875550140380032:0@lo:502: 00000100:00100000:3.0:1788664105.587270:0:7854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664105.587320:0:7854:0:(client.c:2716:ptlrpc_set_wait()) set 000000005303b194 going to sleep for 11 seconds 00000100:00100000:1.0:1788664105.587422:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140380032 00000100:00100000:1.0:1788664105.587429:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140380032 00000100:00100000:1.0:1788664105.587477:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788664105.587485:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be91d7c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:7854:x1875550140380032:12345-0@lo:502: 00000100:00100000:1.0:1788664105.587609:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be91d7c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:7854:x1875550140380032:12345-0@lo:502: Request processed in 114us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664105.587617:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788664105.587818:0:7854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:7854:1875550140380032:0@lo:502: 00000020:01000000:3.0:1788664105.587845:0:7854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664105.587850:0:7854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664105.587851:0:7854:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788664105.587855:0:7854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788664105.588013:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788664105.588035:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788664105.588043:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 000000004ee162a3/0xcd11f61c1413d42a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d431 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664105.588053:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 000000004ee162a3/0xcd11f61c1413d42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d431 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664105.588062:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788664105.588065:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff93c422744d40 from 1 10000000:01000000:1.0:1788664105.588068:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788664105.588097:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 0000000011097d49/0xcd11f61c1413d44d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664105.588104:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 0000000011097d49/0xcd11f61c1413d44d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664105.588112:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 0000000011097d49/0xcd11f61c1413d44d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664105.588126:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017664a6d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140380160:0@lo:101: 00000100:00100000:1.0:1788664105.588171:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664105.588198:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 000000005245a5b1 going to sleep for 11 seconds 00000100:00100000:3.0:1788664105.588290:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140380160 00000100:00100000:3.0:1788664105.588296:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140380160 00000100:00100000:3.0:1788664105.588331:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788664105.588338:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006da03c45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140380160:12345-0@lo:101: 00010000:00010000:3.0:1788664105.588348:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664105.588358:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002a32463c/0xcd11f61c1413d454 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d44d expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.588378:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a32463c/0xcd11f61c1413d454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d44d expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.588387:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002a32463c/0xcd11f61c1413d454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d44d expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.588394:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002a32463c, rc 0) 00000100:00100000:3.0:1788664105.588427:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006da03c45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140380160:12345-0@lo:101: Request processed in 91us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664105.588433:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788664105.588460:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017664a6d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140380160:0@lo:101: 00010000:00010000:3.0:1788664105.588470:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 0000000011097d49/0xcd11f61c1413d44d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d454 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.588478:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 0000000011097d49/0xcd11f61c1413d44d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d454 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664105.588529:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140380288:0@lo:501: 00000100:00100000:3.0:1788664105.588554:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664105.588567:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 000000001442f3cd going to sleep for 11 seconds 00000100:00100000:3.0:1788664105.588578:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140380288 00000100:00100000:3.0:1788664105.588582:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140380288 00000100:00100000:3.0:1788664105.588603:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788664105.588608:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc659572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140380288:12345-0@lo:501: 00000100:00100000:3.0:1788664105.588666:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc659572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140380288:12345-0@lo:501: Request processed in 57us (111us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788664105.588672:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788664105.588699:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140380288:0@lo:501: 10000000:01000000:3.0:1788664105.588721:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788664105.588726:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 0000000011097d49/0xcd11f61c1413d44d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d454 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664105.588732:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 0000000011097d49/0xcd11f61c1413d44d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d454 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664105.588853:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140379392 00000100:00100000:3.0:1788664105.588857:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140379392 00000100:00100000:3.0:1788664105.588886:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788664105.588891:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008364e9e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1875550140379392:12345-0@lo:38: 00010000:00080000:3.0:1788664105.588920:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1788664105.588950:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd11f61c1413d45b 00000004:00100000:3.0:1788664105.588963:0:6517:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788664105.588976:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788664105.589098:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664105.589220:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a941835c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140379648:0@lo:400: 00000100:00100000:0.0:1788664105.589289:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664105.589323:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664105.589329:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3d830e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140379776:0@lo:400: 00000100:00100000:0.0:1788664105.589354:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664105.589383:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140379520 00000100:00100000:0.0:1788664105.589387:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140379520 00000100:00100000:0.0:1788664105.589412:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140379776 00000100:00100000:0.0:1788664105.589414:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140379776 00000100:00100000:0.0:1788664105.589426:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788664105.589431:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1850496 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140379520:12345-0@lo:400: 00000100:00100000:0.0:1788664105.589468:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1850496 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140379520:12345-0@lo:400: Request processed in 37us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664105.589474:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788664105.589486:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788664105.589491:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081414b3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140379776:12345-0@lo:400: 00000100:00100000:0.0:1788664105.589517:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081414b3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140379776:12345-0@lo:400: Request processed in 27us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664105.589523:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788664105.589549:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ceebe604 x1875550140379520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664105.589560:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ceebe604 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140379520:0@lo:400: 00010000:00080000:0.0:1788664105.589581:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d3d830e1 x1875550140379776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664105.589589:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3d830e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140379776:0@lo:400: 00000100:00100000:1.0:1788664105.590293:0:6516:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788664105.590305:0:6516:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788664105.590521:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140379648 00000100:00100000:3.0:1788664105.590527:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140379648 00000100:00100000:1.0:1788664105.590651:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788664105.590659:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f66fe32 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140379648:12345-0@lo:400: 00000100:00100000:1.0:1788664105.590723:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f66fe32 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140379648:12345-0@lo:400: Request processed in 65us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664105.590730:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788664105.591424:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a941835c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140379648:0@lo:400: 00000100:00080000:3.0:1788664105.608206:0:6517:0:(import.c:65:import_set_state_nolock()) 0000000098ca0711 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664105.608307:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008364e9e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1875550140379392:12345-0@lo:38: Request processed in 19414us (25815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664105.608318:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788664105.608467:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788664105.608477:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788664105.608491:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788664105.608496:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788664105.608498:0:3635:0:(import.c:65:import_set_state_nolock()) 00000000eb343cde lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788664105.608551:0:3635:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006585432e): req@00000000ebf63c82 x1875550140379904/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664105.608572:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5614dc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140379392:0@lo:38: 00000100:00100000:1.0:1788664105.608658:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664105.608702:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set 000000006585432e going to sleep for 11 seconds 00000100:00100000:2.0:1788664105.610022:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140379904 00000100:00100000:2.0:1788664105.610034:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140379904 00000100:00100000:2.0:1788664105.610099:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788664105.610111:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a941835c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7859:x1875550140379904:12345-0@lo:1000: 00000100:00100000:2.0:1788664105.610221:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a941835c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7859:x1875550140379904:12345-0@lo:1000: Request processed in 113us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664105.610228:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788664105.610319:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ebf63c82 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7859:1875550140379904:0@lo:1000: 00000040:01000000:1.0:1788664105.610358:0:7859:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788664105.610404:0:7859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ebf63c82 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7859:1875550140380416:0@lo:1000: 00000100:00100000:1.0:1788664105.610444:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664105.610464:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set 000000006585432e going to sleep for 11 seconds 00000100:00100000:2.0:1788664105.611609:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140380416 00000100:00100000:2.0:1788664105.611621:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140380416 00000100:00100000:2.0:1788664105.611671:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788664105.611680:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f15b14b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7859:x1875550140380416:12345-0@lo:1000: 00000100:00100000:2.0:1788664105.611850:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f15b14b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7859:x1875550140380416:12345-0@lo:1000: Request processed in 171us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664105.611858:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788664105.611893:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ebf63c82 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7859:1875550140380416:0@lo:1000: 00000100:00100000:2.0:1788664105.611962:0:7859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a76c3f1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7859:1875550140380544:0@lo:700: 00000100:00100000:2.0:1788664105.611995:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664105.612014:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e46b6f4 going to sleep for 11 seconds 00000100:00100000:3.0:1788664105.612329:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140380544 00000100:00100000:3.0:1788664105.612335:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140380544 00000100:00100000:3.0:1788664105.612372:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664105.612380:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000202d8906 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7859:x1875550140380544:12345-0@lo:700: 00000100:00100000:3.0:1788664105.612427:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000202d8906 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7859:x1875550140380544:12345-0@lo:700: Request processed in 50us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664105.612433:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664105.612488:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140380672:0@lo:41: 00000100:00100000:3.0:1788664105.612522:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664105.612558:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140380672 00000100:00100000:3.0:1788664105.612562:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140380672 00000100:00100000:3.0:1788664105.612585:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788664105.612592:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023fca439 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875550140380672:12345-0@lo:41: 00000004:00000024:3.0:1788664105.612636:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788664105.612667:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023fca439 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875550140380672:12345-0@lo:41: Request processed in 77us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664105.612673:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788664105.612697:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140380672:0@lo:41: 00000100:00100000:2.0:1788664105.612857:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a76c3f1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7859:1875550140380544:0@lo:700: 00000100:00100000:2.0:1788664105.612976:0:7859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a76c3f1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7859:1875550140380800:0@lo:1000: 00000100:00100000:2.0:1788664105.613010:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664105.613025:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set 00000000678cadc3 going to sleep for 11 seconds 00000100:00100000:0.0:1788664105.613160:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140380800 00000100:00100000:0.0:1788664105.613165:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140380800 00000100:00100000:0.0:1788664105.613189:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664105.613194:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b5cb9c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7859:x1875550140380800:12345-0@lo:1000: 00000100:00100000:0.0:1788664105.613253:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b5cb9c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7859:x1875550140380800:12345-0@lo:1000: Request processed in 59us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664105.613260:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788664105.615794:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a76c3f1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7859:1875550140380800:0@lo:1000: 00000004:00080000:2.0:1788664105.615867:0:7859:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000009e46b6f4 with version 0 00000020:00100000:2.0:1788664105.615890:0:7859:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788664105.615896:0:7859:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006a76c3f1 x1875550140381056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664105.615926:0:7859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a76c3f1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7859:1875550140381056:0@lo:1000: 00000100:00100000:2.0:1788664105.615977:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664105.616007:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b70b6473 going to sleep for 11 seconds 00000100:00100000:3.0:1788664105.616081:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140381056 00000100:00100000:3.0:1788664105.616089:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140381056 00000100:00100000:3.0:1788664105.616138:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788664105.616146:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006415dcba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7859:x1875550140381056:12345-0@lo:1000: 00000001:00080000:1.0:1788664105.625025:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1788664105.625051:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788664105.625244:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006415dcba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7859:x1875550140381056:12345-0@lo:1000: Request processed in 9092us (9259us total) trans 4294967297 rc 0/0 00000004:00080000:1.0:1788664105.625268:0:7859:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788664105.625273:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788664105.625273:0:7859:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788664105.625290:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a76c3f1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7859:1875550140381056:0@lo:1000: 00000100:00100000:1.0:1788664105.625393:0:7859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1ee57b9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7859:1875550140381184:0@lo:1000: 00000100:00100000:1.0:1788664105.625435:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664105.625466:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082b6a1cb going to sleep for 11 seconds 00000100:00100000:0.0:1788664105.625571:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140381184 00000100:00100000:0.0:1788664105.625578:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140381184 00000100:00100000:0.0:1788664105.625635:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788664105.625643:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae20e897 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7859:x1875550140381184:12345-0@lo:1000: 00000100:00100000:0.0:1788664105.625713:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae20e897 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7859:x1875550140381184:12345-0@lo:1000: Request processed in 71us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664105.625719:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788664105.626848:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1ee57b9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7859:1875550140381184:0@lo:1000: 00000040:00080000:1.0:1788664105.626874:0:7859:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788664105.626919:0:7859:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000004ef39f96 with version 1 00000004:00080000:3.0:1788664105.627318:0:7856:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000003588f0cb version 1 rpc_version 1 00000020:00100000:3.0:1788664105.627344:0:7856:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788664105.627352:0:7856:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001acb238c x1875550140381440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788664105.627370:0:7856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7856:1875550140381440:0@lo:1000: 00000100:00100000:3.0:1788664105.627483:0:7856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664105.627515:0:7856:0:(client.c:2716:ptlrpc_set_wait()) set 000000001442f3cd going to sleep for 11 seconds 00000040:00080000:1.0:1788664105.628958:0:7859:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788664105.629029:0:7859:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788664105.629034:0:7859:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1788664105.629301:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140381440 00000100:00100000:0.0:1788664105.629310:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140381440 00000100:00100000:0.0:1788664105.629456:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788664105.629465:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012afddfb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7856:x1875550140381440:12345-0@lo:1000: 00000001:00080000:1.0:1788664105.632103:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1788664105.632723:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012afddfb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7856:x1875550140381440:12345-0@lo:1000: Request processed in 3254us (5235us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788664105.632736:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:3.0:1788664105.632861:0:7856:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788664105.632866:0:7856:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788664105.632885:0:7856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7856:1875550140381440:0@lo:1000: 00000020:00000004:0.0:1788664105.651664:0:7871:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788664105.652203:0:7871:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788664106.432458:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788664106.744677:0:7919:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd19478e20 20000000:00000080:2.0:1788664106.744702:0:7919:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c43527e800 uarg=0000000000000000 20000000:01000000:2.0:1788664106.744763:0:7919:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788664106.745032:0:7919:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788664106.745039:0:7919:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788664106.745138:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788664106.745154:0:7919:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788664106.749973:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788664106.751235:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788664106.751299:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788664106.751322:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788664106.751344:0:7919:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788664106.751369:0:7919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000057d37af7/0xcd11f61c1413d462 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664106.751392:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000de29ccc/0xcd11f61c1413d2e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d2da expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664106.751398:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004da089db/0xcd11f61c1413d3cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d3c8 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664106.751405:0:7919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000057d37af7/0xcd11f61c1413d462 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664106.752643:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004da089db/0xcd11f61c1413d3cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d3c8 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664106.752680:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004da089db/0xcd11f61c1413d3cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d3c8 expref: 17 pid: 6506 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664106.752698:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875550140381568:0@lo:104: 00000100:00100000:3.0:1788664106.752808:0:7919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664106.753078:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000de29ccc/0xcd11f61c1413d2e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d2da expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664106.753090:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000de29ccc/0xcd11f61c1413d2e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d2da expref: 17 pid: 6504 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664106.753099:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000162b7f5e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875550140381696:0@lo:104: 00000100:00100000:2.0:1788664106.753141:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788664106.753191:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664106.753298:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140381568 00000100:00100000:2.0:1788664106.753308:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140381568 00000100:00100000:2.0:1788664106.753348:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140381696 00000100:00100000:2.0:1788664106.753351:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140381696 00000100:00100000:2.0:1788664106.753366:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788664106.753373:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3d91af2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:7919:x1875550140381568:12345-0@lo:104: 00010000:00010000:2.0:1788664106.753407:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 0000000038fa4207/0xcd11f61c1413d3c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d3cf expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664106.753468:0:7919:0:(client.c:2716:ptlrpc_set_wait()) set 0000000079d61f74 going to sleep for 11 seconds 00010000:00010000:2.0:1788664106.753487:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664106.753494:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3d91af2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:7919:x1875550140381568:12345-0@lo:104: Request processed in 122us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664106.753502:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788664106.753524:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664106.753534:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 0000000038fa4207/0xcd11f61c1413d3c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d3cf expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664106.753544:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000038fa4207 already unused, calling callback (00000000b4c0f7fd) 10000000:00010000:1.0:1788664106.753548:0:7453:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 0000000038fa4207/0xcd11f61c1413d3c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d3cf expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664106.753553:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788664106.753567:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc04baba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:7919:x1875550140381696:12345-0@lo:104: 00010000:00010000:1.0:1788664106.753580:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 0000000038fa4207/0xcd11f61c1413d3c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d3cf expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664106.753661:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001acb238c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875550140381568:0@lo:104: 00010000:00010000:2.0:1788664106.753955:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000fb1cbd50/0xcd11f61c1413d2da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d2e1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664106.754010:0:7453:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 0000000038fa4207/0xcd11f61c1413d3c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d3cf expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664106.754031:0:7453:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788664106.754109:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 0000000038fa4207/0xcd11f61c1413d3c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d3cf expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664106.754116:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664106.754161:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 0000000038fa4207/0xcd11f61c1413d3c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d3cf expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664106.754169:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 0000000038fa4207/0xcd11f61c1413d3c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d3cf expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664106.754188:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664106.754191:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664106.754193:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664106.754204:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664106.754224:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1ee57b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140381824:0@lo:103: 00000100:00100000:1.0:1788664106.754287:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664106.754364:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140381824 00000100:00100000:1.0:1788664106.754372:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140381824 00010000:00010000:1.0:1788664106.754406:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004da089db/0xcd11f61c1413d3cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d3c8 expref: 18 pid: 6506 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664106.754453:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788664106.754467:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1317b83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+18:3636:x1875550140381824:12345-0@lo:103: 00010000:00010000:1.0:1788664106.754485:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664106.754493:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004da089db/0xcd11f61c1413d3cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d3c8 expref: 18 pid: 6506 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664106.754507:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004da089db/0xcd11f61c1413d3cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d3c8 expref: 18 pid: 6506 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664106.754537:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004da089db/0xcd11f61c1413d3cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d3c8 expref: 18 pid: 6506 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664106.754555:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664106.754750:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1317b83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+17:3636:x1875550140381824:12345-0@lo:103: Request processed in 287us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664106.754762:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788664106.754889:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1ee57b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140381824:0@lo:103: 00010000:00010000:3.0:1788664106.755269:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788664106.755276:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc04baba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:7919:x1875550140381696:12345-0@lo:104: Request processed in 1711us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664106.755291:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788664106.755359:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000162b7f5e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875550140381696:0@lo:104: 00010000:00010000:2.0:1788664106.755401:0:7919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000057d37af7/0xcd11f61c1413d462 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.755406:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664106.755416:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000fb1cbd50/0xcd11f61c1413d2da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d2e1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.755428:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fb1cbd50 already unused, calling callback (00000000b4c0f7fd) 10000000:00010000:0.0:1788664106.755433:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000fb1cbd50/0xcd11f61c1413d2da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d2e1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.755456:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000fb1cbd50/0xcd11f61c1413d2da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d2e1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664106.755462:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000fb1cbd50/0xcd11f61c1413d2da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d2e1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664106.755468:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664106.755547:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000fb1cbd50/0xcd11f61c1413d2da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d2e1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.755554:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664106.755592:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000fb1cbd50/0xcd11f61c1413d2da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d2e1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.755599:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000fb1cbd50/0xcd11f61c1413d2da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d2e1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.755617:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664106.755618:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664106.755620:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664106.755698:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f6b5111 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140381952:0@lo:103: 00000100:00100000:1.0:1788664106.755739:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664106.755869:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140381952 00000100:00100000:0.0:1788664106.755876:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140381952 00010000:00010000:0.0:1788664106.755912:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000de29ccc/0xcd11f61c1413d2e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d2da expref: 17 pid: 6504 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664106.755939:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788664106.755948:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098671ebc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+17:3638:x1875550140381952:12345-0@lo:103: 00010000:00010000:0.0:1788664106.755959:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664106.755963:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000de29ccc/0xcd11f61c1413d2e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d2da expref: 17 pid: 6504 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.755980:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000de29ccc/0xcd11f61c1413d2e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d2da expref: 17 pid: 6504 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.755993:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000de29ccc/0xcd11f61c1413d2e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d2da expref: 17 pid: 6504 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.756007:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000057d37af7/0xcd11f61c1413d462 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.756014:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000057d37af7/0xcd11f61c1413d462 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.756031:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000057d37af7/0xcd11f61c1413d462 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.756038:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000057d37af7/0xcd11f61c1413d462 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.756044:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000057d37af7/0xcd11f61c1413d462 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.756050:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000057d37af7/0xcd11f61c1413d462 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.756056:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000057d37af7 already unused, calling callback (0000000001315907) 00010000:00010000:0.0:1788664106.756060:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000057d37af7/0xcd11f61c1413d462 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.756067:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000057d37af7/0xcd11f61c1413d462 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.756089:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000057d37af7/0xcd11f61c1413d462 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664106.756102:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664106.756155:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098671ebc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+16:3638:x1875550140381952:12345-0@lo:103: Request processed in 209us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664106.756164:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788664106.756193:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f6b5111 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140381952:0@lo:103: 00010000:00010000:2.0:1788664106.756722:0:7919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000057d37af7/0xcd11f61c1413d462 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664106.756735:0:7919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000057d37af7/0xcd11f61c1413d462 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664106.756740:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000057d37af7/0xcd11f61c1413d462 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664107.081960:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a76c3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140382080:0@lo:41: 00000100:00100000:0.0:1788664107.082033:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664107.082271:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140382080 00000100:00100000:3.0:1788664107.082280:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140382080 00000100:00100000:3.0:1788664107.082329:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788664107.082336:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f6b5111 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140382080:12345-0@lo:41: 00000004:00000024:3.0:1788664107.082373:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788664107.082421:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f6b5111 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140382080:12345-0@lo:41: Request processed in 85us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664107.082427:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788664107.082473:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a76c3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140382080:0@lo:41: 00010000:00010000:3.0:1788664107.457010:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664108.477876:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664109.506735:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664110.527582:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664110.654661:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cc4691bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140382208:0@lo:41: 00000100:00100000:0.0:1788664110.654750:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664110.654859:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140382208 00000100:00100000:0.0:1788664110.654875:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140382208 00000100:00100000:0.0:1788664110.654928:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788664110.654937:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2bc758d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140382208:12345-0@lo:41: 00000004:00000024:0.0:1788664110.654975:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788664110.655030:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2bc758d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140382208:12345-0@lo:41: Request processed in 94us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664110.655039:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788664110.655096:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cc4691bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140382208:0@lo:41: 00000100:00100000:0.0:1788664110.655984:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000464c34d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140382464:0@lo:400: 00000100:00100000:0.0:1788664110.656028:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664110.656059:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664110.656074:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000317569fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140382592:0@lo:400: 00000100:00100000:0.0:1788664110.656098:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664110.656128:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140382464 00000100:00100000:0.0:1788664110.656134:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140382464 00000100:00100000:0.0:1788664110.656176:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788664110.656183:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a54f961 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140382464:12345-0@lo:400: 00000100:00100000:0.0:1788664110.656227:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a54f961 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140382464:12345-0@lo:400: Request processed in 44us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664110.656234:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788664110.656255:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140382592 00000100:00100000:0.0:1788664110.656258:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140382592 00000100:00100000:0.0:1788664110.656279:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788664110.656284:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e980f7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140382592:12345-0@lo:400: 00000100:00100000:0.0:1788664110.656313:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e980f7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140382592:12345-0@lo:400: Request processed in 30us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664110.656319:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788664110.656346:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cc4691bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140382336:0@lo:400: 00000100:00100000:0.0:1788664110.656385:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664110.656427:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664110.656432:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014e3d607 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140382720:0@lo:400: 00000100:00100000:0.0:1788664110.656454:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664110.656480:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140382336 00000100:00100000:0.0:1788664110.656484:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140382336 00000100:00100000:0.0:1788664110.656513:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788664110.656520:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f65e2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:3637:x1875550140382336:12345-0@lo:400: 00000100:00100000:0.0:1788664110.656561:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f65e2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:3637:x1875550140382336:12345-0@lo:400: Request processed in 42us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664110.656578:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788664110.656609:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140382720 00000100:00100000:0.0:1788664110.656613:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140382720 00000100:00100000:0.0:1788664110.656636:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788664110.656642:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001af71e8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140382720:12345-0@lo:400: 00000100:00100000:0.0:1788664110.656672:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001af71e8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140382720:12345-0@lo:400: Request processed in 30us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664110.656678:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788664110.656948:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000014e3d607 x1875550140382720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664110.656963:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014e3d607 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140382720:0@lo:400: 00000100:00100000:0.0:1788664110.656974:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cc4691bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140382336:0@lo:400: 00000100:00100000:0.0:1788664110.657004:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000317569fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140382592:0@lo:400: 00010000:00080000:0.0:1788664110.657015:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000464c34d2 x1875550140382464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664110.657024:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000464c34d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140382464:0@lo:400: 00010000:00010000:1.0:1788664111.551197:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664112.190187:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a76c3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140382848:0@lo:41: 00000100:00100000:0.0:1788664112.190272:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664112.190362:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140382848 00000100:00100000:3.0:1788664112.190370:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140382848 00000100:00100000:3.0:1788664112.190427:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788664112.190437:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000464c34d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140382848:12345-0@lo:41: 00000004:00000024:3.0:1788664112.190472:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788664112.196299:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000464c34d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140382848:12345-0@lo:41: Request processed in 5655us (5819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664112.196316:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788664112.197067:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a76c3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140382848:0@lo:41: 00010000:00010000:1.0:1788664112.575887:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664113.604152:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664114.624737:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788664115.261921:0:6508:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:3.0:1788664115.261931:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c42d99f800 from 1 10000000:01000000:3.0:1788664115.261936:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788664115.261980:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000baf442b6/0xcd11f61c1413d469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664115.261991:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000baf442b6/0xcd11f61c1413d469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664115.262002:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000baf442b6/0xcd11f61c1413d469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664115.262025:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee68d3c7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140382976:0@lo:101: 00000100:00100000:3.0:1788664115.262254:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664115.262358:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d551697f going to sleep for 11 seconds 00000100:00100000:1.0:1788664115.263610:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140382976 00000100:00100000:1.0:1788664115.263623:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140382976 00000100:00100000:3.0:1788664115.264077:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788664115.264095:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000701a2df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140382976:12345-0@lo:101: 00010000:00010000:3.0:1788664115.264289:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664115.264309:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d8c3524/0xcd11f61c1413d470 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d469 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664115.264337:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d8c3524/0xcd11f61c1413d470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d469 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664115.264362:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d8c3524/0xcd11f61c1413d470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d469 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664115.264371:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d8c3524, rc 0) 00000100:00100000:3.0:1788664115.264465:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000701a2df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140382976:12345-0@lo:101: Request processed in 378us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664115.264472:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788664115.264560:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee68d3c7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140382976:0@lo:101: 00010000:00010000:1.0:1788664115.264579:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000baf442b6/0xcd11f61c1413d469 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d470 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664115.264587:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000baf442b6/0xcd11f61c1413d469 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d470 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664115.264664:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000407ff0cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140383104:0@lo:501: 00000100:00100000:1.0:1788664115.264698:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664115.265381:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d60e8ddd going to sleep for 11 seconds 00000100:00100000:0.0:1788664115.265504:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140383104 00000100:00100000:0.0:1788664115.265512:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140383104 00000100:00100000:0.0:1788664115.265543:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788664115.265560:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fcb47781 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140383104:12345-0@lo:501: 00000100:00100000:0.0:1788664115.265706:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fcb47781 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140383104:12345-0@lo:501: Request processed in 147us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664115.265714:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788664115.265876:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000407ff0cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140383104:0@lo:501: 00000100:00100000:1.0:1788664115.265943:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000407ff0cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140383232:0@lo:503: 00000100:00100000:1.0:1788664115.265993:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664115.266020:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d60e8ddd going to sleep for 11 seconds 00000100:00100000:0.0:1788664115.266378:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140383232 00000100:00100000:0.0:1788664115.266384:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140383232 00000100:00100000:0.0:1788664115.266419:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788664115.266425:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006de75763 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140383232:12345-0@lo:503: 00000100:00100000:0.0:1788664115.266526:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006de75763 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140383232:12345-0@lo:503: Request processed in 101us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664115.266534:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788664115.266698:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000407ff0cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140383232:0@lo:503: 00000100:00100000:1.0:1788664115.267618:0:8337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000407ff0cd pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8337:1875550140383360:0@lo:502: 00000100:00100000:1.0:1788664115.267683:0:8337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664115.267716:0:8337:0:(client.c:2716:ptlrpc_set_wait()) set 00000000553fc44b going to sleep for 11 seconds 00000100:00100000:0.0:1788664115.267821:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140383360 00000100:00100000:0.0:1788664115.267827:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140383360 00000100:00100000:0.0:1788664115.267863:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788664115.267870:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f22f90a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:8337:x1875550140383360:12345-0@lo:502: 00000100:00100000:0.0:1788664115.267962:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f22f90a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:8337:x1875550140383360:12345-0@lo:502: Request processed in 93us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664115.267970:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788664115.268392:0:8337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000407ff0cd pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8337:1875550140383360:0@lo:502: 00000020:01000000:0.0:1788664115.268429:0:8337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788664115.268439:0:8337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664115.268441:0:8337:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788664115.268447:0:8337:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c42d99f800 00000020:00000080:0.0:1788664115.268449:0:8337:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788664115.268494:0:8337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8337:1875550140383488:0@lo:502: 00000100:00100000:0.0:1788664115.268533:0:8337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664115.268565:0:8337:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c422632480 going to sleep for 11 seconds 00000100:00100000:3.0:1788664115.268595:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140383488 00000100:00100000:3.0:1788664115.268600:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140383488 00000100:00100000:3.0:1788664115.268635:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788664115.268650:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:8337:x1875550140383488:12345-0@lo:502: 00000100:00100000:3.0:1788664115.268755:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:8337:x1875550140383488:12345-0@lo:502: Request processed in 113us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664115.268763:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788664115.268874:0:8337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8337:1875550140383488:0@lo:502: 00000020:01000000:0.0:1788664115.268892:0:8337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664115.268897:0:8337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664115.268899:0:8337:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788664115.268902:0:8337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788664115.269064:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788664115.269105:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788664115.269122:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d469 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d470 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664115.269133:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d470 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664115.269143:0:6508:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788664115.269146:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c40641a800 from 1 10000000:01000000:1.0:1788664115.269148:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664115.269172:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d477 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664115.269179:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d477 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664115.269188:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d477 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664115.269200:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140383616:0@lo:101: 00000100:00100000:1.0:1788664115.269230:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664115.269256:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43535de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664115.269494:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140383616 00000100:00100000:0.0:1788664115.269500:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140383616 00000100:00100000:0.0:1788664115.269537:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788664115.269546:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140383616:12345-0@lo:101: 00010000:00010000:0.0:1788664115.269556:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664115.269569:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c400031600/0xcd11f61c1413d47e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d477 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664115.269589:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c400031600/0xcd11f61c1413d47e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d477 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664115.269599:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c400031600/0xcd11f61c1413d47e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d477 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664115.269607:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400031600, rc 0) 00000100:00100000:0.0:1788664115.269645:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140383616:12345-0@lo:101: Request processed in 100us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664115.269651:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788664115.270589:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140383616:0@lo:101: 00010000:00010000:1.0:1788664115.270608:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d477 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d47e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664115.270618:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d477 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d47e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664115.270694:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140383744:0@lo:501: 00000100:00100000:1.0:1788664115.270741:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664115.270798:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43535de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664115.270947:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140383744 00000100:00100000:0.0:1788664115.270952:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140383744 00000100:00100000:0.0:1788664115.270978:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788664115.270985:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140383744:12345-0@lo:501: 00000100:00100000:0.0:1788664115.271102:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140383744:12345-0@lo:501: Request processed in 116us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664115.271131:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788664115.271365:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140383744:0@lo:501: 00000100:00100000:1.0:1788664115.271393:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140383872:0@lo:503: 00000100:00100000:1.0:1788664115.271504:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664115.271530:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43535de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664115.271578:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140383872 00000100:00100000:0.0:1788664115.271584:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140383872 00000100:00100000:0.0:1788664115.271603:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788664115.271609:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140383872:12345-0@lo:503: 00000100:00100000:0.0:1788664115.271701:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140383872:12345-0@lo:503: Request processed in 91us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664115.271709:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788664115.271865:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140383872:0@lo:503: 00000100:00100000:1.0:1788664115.275747:0:8338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8338:1875550140384000:0@lo:502: 00000100:00100000:1.0:1788664115.275862:0:8338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664115.275906:0:8338:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43535d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788664115.276139:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140384000 00000100:00100000:3.0:1788664115.276147:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140384000 00000100:00100000:3.0:1788664115.276201:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788664115.276211:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:8338:x1875550140384000:12345-0@lo:502: 00000100:00100000:3.0:1788664115.276349:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:8338:x1875550140384000:12345-0@lo:502: Request processed in 139us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664115.276357:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788664115.276955:0:8338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8338:1875550140384000:0@lo:502: 00000020:01000000:1.0:1788664115.276989:0:8338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664115.276998:0:8338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664115.277001:0:8338:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788664115.277010:0:8338:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c40641a800 00000020:00000080:1.0:1788664115.277013:0:8338:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788664115.277051:0:8338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8338:1875550140384128:0@lo:502: 00000100:00100000:1.0:1788664115.277295:0:8338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664115.277341:0:8338:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43535d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788664115.278355:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140384128 00000100:00100000:3.0:1788664115.278368:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140384128 00000100:00100000:3.0:1788664115.278432:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788664115.278442:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+18:8338:x1875550140384128:12345-0@lo:502: 00000100:00100000:3.0:1788664115.278573:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+18:8338:x1875550140384128:12345-0@lo:502: Request processed in 132us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664115.278586:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788664115.278766:0:8338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8338:1875550140384128:0@lo:502: 00000020:01000000:1.0:1788664115.278845:0:8338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664115.278854:0:8338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664115.278856:0:8338:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788664115.278860:0:8338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788664115.279215:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788664115.279238:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788664115.279248:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d477 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d47e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664115.279259:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d477 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d47e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664115.656727:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664115.775105:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140384256:0@lo:400: 00000100:00100000:0.0:1788664115.775175:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664115.775236:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140384768:0@lo:400: 00000100:00100000:0.0:1788664115.775265:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664115.775303:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664115.775311:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140384384:0@lo:400: 00000100:00100000:0.0:1788664115.775342:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664115.775375:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140384640:0@lo:400: 00000100:00100000:3.0:1788664115.775404:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140384256 00000100:00100000:3.0:1788664115.775415:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140384256 00000100:00100000:0.0:1788664115.775423:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664115.775448:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664115.775455:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140384512:0@lo:41: 00000100:00100000:3.0:1788664115.775465:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140384640 00000100:00100000:3.0:1788664115.775470:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140384640 00000100:00100000:0.0:1788664115.775484:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664115.775495:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788664115.775506:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140384256:12345-0@lo:400: 00000100:00100000:0.0:1788664115.775523:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140384768 00000100:00100000:0.0:1788664115.775529:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140384768 00000100:00100000:0.0:1788664115.775560:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140384384 00000100:00100000:0.0:1788664115.775564:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140384384 00000100:00100000:3.0:1788664115.775577:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140384256:12345-0@lo:400: Request processed in 71us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664115.775584:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140384512 00000100:00100000:3.0:1788664115.775589:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788664115.775590:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140384512 00000100:00100000:0.0:1788664115.775614:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788664115.775617:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788664115.775627:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140384640:12345-0@lo:400: 00000100:00100000:0.0:1788664115.775635:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875550140384768:12345-0@lo:400: 00000100:00100000:3.0:1788664115.775678:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140384640:12345-0@lo:400: Request processed in 53us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664115.775685:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875550140384768:12345-0@lo:400: Request processed in 55us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664115.775686:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664115.775699:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788664115.775719:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788664115.775727:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140384384:12345-0@lo:400: 00000100:00100000:0.0:1788664115.775757:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140384384:12345-0@lo:400: Request processed in 31us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664115.775763:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788664115.775817:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788664115.775824:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140384512:12345-0@lo:41: 00000004:00000024:0.0:1788664115.775858:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788664115.775889:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140384512:12345-0@lo:41: Request processed in 66us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664115.775895:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788664115.775944:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140384384:0@lo:400: 00010000:00080000:0.0:1788664115.775959:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c42266b800 x1875550140384256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664115.775969:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140384256:0@lo:400: 00000100:00100000:0.0:1788664115.775977:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140384768:0@lo:400: 00000100:00100000:2.0:1788664115.776162:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140384512:0@lo:41: 00010000:00080000:2.0:1788664115.776176:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c42266aa00 x1875550140384640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664115.776193:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140384640:0@lo:400: 00010000:00010000:0.0:1788664116.674072:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788664117.002702:0:8420:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:3.0:1788664117.002705:0:8420:0:(obd_mount.c:924:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788664117.002707:0:8420:0:(obd_mount.c:927:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788664117.003556:0:8420:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c42f78b000 00000020:01000004:3.0:1788664117.003575:0:8420:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788664117.003587:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788664117.003615:0:8420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93c435374d40) 00000020:00000080:3.0:1788664117.003633:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788664117.075166:0:8420:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788664117.075234:0:8420:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1788664117.126054:0:8420:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788664117.126325:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788664117.126336:0:8420:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788664117.126348:0:8420:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd11f61c1413d48c 00000020:01000004:3.0:1788664117.126355:0:8420:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788664117.126376:0:8420:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788664117.126380:0:8420:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788664117.126386:0:8420:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788664117.126391:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788664117.126401:0:8420:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93c435373380) 00000020:00000080:3.0:1788664117.126412:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1788664117.130689:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788664117.130906:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788664117.130913:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788664117.137544:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788664117.137559:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788664117.138066:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788664117.138083:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788664117.147604:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788664117.147807:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788664117.147813:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788664117.151880:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788664117.151896:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788664117.186576:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664117.187276:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788664117.187285:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788664117.189329:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788664117.189342:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788664117.195362:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788664117.195379:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788664117.199260:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664117.199510:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788664117.199518:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788664117.203574:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788664117.203592:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788664117.275453:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788664117.275677:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788664117.275685:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788664117.278361:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788664117.278374:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788664117.279168:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788664117.279209:0:8420:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788664117.279217:0:8420:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000100:00100000:3.0:1788664117.311415:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664117.311443:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140384896:0@lo:41: 00000100:00100000:3.0:1788664117.311529:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664117.311667:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140384896 00000100:00100000:2.0:1788664117.311676:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140384896 00000100:00100000:2.0:1788664117.311742:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788664117.311755:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140384896:12345-0@lo:41: 00000004:00000024:2.0:1788664117.311817:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788664117.311890:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140384896:12345-0@lo:41: Request processed in 127us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664117.311899:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788664117.311955:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140384896:0@lo:41: 00000040:01000000:1.0:1788664117.317109:0:8420:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788664117.317149:0:8420:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788664117.317153:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788664117.317155:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788664117.317156:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664117.317157:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664117.317159:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664117.317160:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664117.317161:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664117.317163:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788664117.317165:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788664117.317166:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664117.317168:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788664117.317177:0:8420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788664117.317179:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788664117.317180:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788664117.317181:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664117.317182:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664117.317183:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664117.317184:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664117.317185:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664117.317186:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788664117.317187:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788664117.317187:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664117.317189:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788664117.317214:0:8420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788664117.317234:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140385024:0@lo:253: 00000100:00100000:1.0:1788664117.317433:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664117.317519:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c405e520c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664117.319349:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140385024 00000100:00100000:3.0:1788664117.319363:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140385024 00000100:00100000:3.0:1788664117.319468:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788664117.319479:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+18:8420:x1875550140385024:12345-0@lo:253: 20000000:01000000:3.0:1788664117.319542:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788664117.319546:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788664117.319551:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788664117.319567:0:6506:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788664117.320123:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788664117.320302:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788664117.320319:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788664117.320336:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788664117.320342:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788664117.320354:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788664117.321585:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788664117.322272:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788664117.322371:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:3.0:1788664117.322374:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:3.0:1788664117.322392:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788664117.322398:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788664117.322411:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788664117.322416:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:3.0:1788664117.322428:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788664117.322434:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788664117.322445:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788664117.322460:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788664117.322537:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1788664117.322549:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:3.0:1788664117.322551:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:3.0:1788664117.322565:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1788664117.322570:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788664117.322583:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1788664117.322588:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:3.0:1788664117.322601:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1788664117.322607:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788664117.322617:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1788664117.322628:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1788664117.326640:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1788664117.326688:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:3.0:1788664117.326691:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:3.0:1788664117.326723:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1788664117.326731:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788664117.326746:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1788664117.326752:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:3.0:1788664117.326810:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1788664117.326834:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788664117.326851:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1788664117.326867:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788664117.327683:0:6506:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788664117.327687:0:6506:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788664117.327691:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788664117.327761:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788664117.327763:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788664117.329724:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1788664117.329805:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1788664117.329838:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788664117.330068:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788664117.330092:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788664117.330107:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1788664117.330115:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788664117.330118:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788664117.330652:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788664117.330837:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788664117.330860:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788664117.330876:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788664117.330885:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788664117.330887:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788664117.331564:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1788664117.331599:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1788664117.331617:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1788664117.331836:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1788664117.331860:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1788664117.331875:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1788664117.331885:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788664117.331888:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788664117.332527:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1788664117.332552:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1788664117.332569:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788664117.332731:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788664117.332752:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788664117.332766:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:2.0:1788664117.335518:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788664117.335552:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d49a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.335572:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c400030c00/0xcd11f61c1413d366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d35f expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.335580:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c40153b200/0xcd11f61c1413d3dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d3d6 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.335587:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d40e expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.335594:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d42a expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.335600:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4351efe00/0xcd11f61c1413d454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d44d expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.335608:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d49a lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.335654:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4351efe00/0xcd11f61c1413d454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d44d expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.335686:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c4351efe00/0xcd11f61c1413d454 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d44d expref: 18 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664117.335763:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140385152:0@lo:104: 00000100:00100000:2.0:1788664117.337122:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664117.337326:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d42a expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.337339:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d42a expref: 18 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664117.337352:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140385280:0@lo:104: 00000100:00100000:2.0:1788664117.337376:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664117.337525:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d40e expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.337534:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d415 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d40e expref: 18 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664117.337544:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140385408:0@lo:104: 00000100:00100000:2.0:1788664117.337566:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664117.337621:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140385152 00000100:00100000:3.0:1788664117.337629:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140385152 00000100:00100000:3.0:1788664117.337672:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140385280 00000100:00100000:3.0:1788664117.337675:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140385280 00000100:00100000:3.0:1788664117.337691:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788664117.337710:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e889180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:6506:x1875550140385152:12345-0@lo:104: 00010000:00010000:3.0:1788664117.337724:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413d44d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d454 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.337801:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788664117.337808:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e889180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:6506:x1875550140385152:12345-0@lo:104: Request processed in 110us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664117.337816:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788664117.337862:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788664117.337869:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:6506:x1875550140385280:12345-0@lo:104: 00010000:00010000:3.0:1788664117.337877:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d431 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.337922:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788664117.337927:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:6506:x1875550140385280:12345-0@lo:104: Request processed in 59us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664117.337933:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788664117.338142:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664117.338156:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413d44d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d454 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.338163:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e3600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664117.338167:0:7453:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413d44d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d454 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.338176:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413d44d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d454 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664117.338184:0:7453:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413d44d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d454 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664117.338191:0:7453:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664117.338229:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413d44d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d454 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.338236:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664117.338257:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413d44d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d454 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.338265:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413d44d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d454 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.338288:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664117.338292:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d431 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.338299:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40153be00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664117.338301:0:7453:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d431 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.338318:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d42a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d431 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664117.338325:0:7453:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d42a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d431 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664117.338329:0:7453:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664117.338343:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d42a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d431 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.338349:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664117.338355:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d42a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d431 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.338361:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d42a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d431 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.338370:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664117.338372:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664117.338373:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664117.338387:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140385536:0@lo:103: 00000100:00100000:0.0:1788664117.338419:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.338454:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664117.338460:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140385664:0@lo:103: 00000100:00100000:0.0:1788664117.338482:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.338516:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140385536 00000100:00100000:0.0:1788664117.338521:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140385536 00010000:00010000:0.0:1788664117.338542:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4351efe00/0xcd11f61c1413d454 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d44d expref: 19 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664117.338578:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140385664 00000100:00100000:0.0:1788664117.338582:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140385664 00010000:00010000:0.0:1788664117.338595:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d431 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d42a expref: 20 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664117.338608:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788664117.338614:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+20:3636:x1875550140385536:12345-0@lo:103: 00010000:00010000:0.0:1788664117.338625:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664117.338631:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4351efe00/0xcd11f61c1413d454 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d44d expref: 20 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.338641:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4351efe00/0xcd11f61c1413d454 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d44d expref: 20 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.338656:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664117.338686:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+20:3636:x1875550140385536:12345-0@lo:103: Request processed in 72us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664117.338693:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788664117.338722:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788664117.338729:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+19:3636:x1875550140385664:12345-0@lo:103: 00010000:00010000:0.0:1788664117.338737:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664117.338741:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d431 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d42a expref: 19 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.338750:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d42a expref: 19 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.338760:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664117.338836:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+19:3636:x1875550140385664:12345-0@lo:103: Request processed in 93us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664117.338843:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788664117.338897:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140385664:0@lo:103: 00000100:00100000:0.0:1788664117.338908:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140385536:0@lo:103: 00010000:00010000:2.0:1788664117.339665:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c40153b200/0xcd11f61c1413d3dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d3d6 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.339678:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c40153b200/0xcd11f61c1413d3dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d3d6 expref: 18 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664117.339688:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140385792:0@lo:104: 00000100:00100000:2.0:1788664117.339738:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664117.339796:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c400030c00/0xcd11f61c1413d366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d35f expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.339804:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c400030c00/0xcd11f61c1413d366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d35f expref: 18 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664117.339813:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140385920:0@lo:104: 00000100:00100000:3.0:1788664117.339911:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140385408 00000100:00100000:3.0:1788664117.339919:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140385408 00000100:00100000:3.0:1788664117.339944:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140385792 00000100:00100000:3.0:1788664117.339948:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140385792 00000100:00100000:3.0:1788664117.339961:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788664117.339969:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:6506:x1875550140385408:12345-0@lo:104: 00010000:00010000:3.0:1788664117.339980:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c40153b600/0xcd11f61c1413d40e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d415 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.340029:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788664117.340035:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:6506:x1875550140385408:12345-0@lo:104: Request processed in 67us (2468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664117.340041:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788664117.340056:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788664117.340062:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:6506:x1875550140385792:12345-0@lo:104: 00010000:00010000:3.0:1788664117.340070:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d3d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d3dd expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.340128:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788664117.340138:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:6506:x1875550140385792:12345-0@lo:104: Request processed in 76us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664117.340144:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788664117.340374:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664117.340380:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c40153b600/0xcd11f61c1413d40e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d415 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.340388:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40153b600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664117.340393:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c40153b600/0xcd11f61c1413d40e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d415 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.340402:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c40153b600/0xcd11f61c1413d40e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d415 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664117.340410:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c40153b600/0xcd11f61c1413d40e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d415 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664117.340416:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664117.340443:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c40153b600/0xcd11f61c1413d40e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d415 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.340449:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664117.340470:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c40153b600/0xcd11f61c1413d40e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d415 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.340477:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c40153b600/0xcd11f61c1413d40e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d415 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.340503:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664117.340506:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d3d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d3dd expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.340512:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400031400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664117.340515:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d3d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d3dd expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.340522:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d3d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d3dd expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664117.340528:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d3d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d3dd expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664117.340533:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664117.340546:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d3d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d3dd expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.340551:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664117.340556:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d3d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d3dd expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.340561:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d3d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d3dd expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.340570:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664117.340572:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664117.340573:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664117.340586:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140386048:0@lo:103: 00000100:00100000:0.0:1788664117.340623:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.340654:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664117.340660:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140386176:0@lo:103: 00000100:00100000:0.0:1788664117.340679:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.340705:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140386048 00000100:00100000:0.0:1788664117.340709:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140386048 00010000:00010000:0.0:1788664117.340727:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d415 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d40e expref: 19 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664117.340746:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140386176 00000100:00100000:0.0:1788664117.340748:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140386176 00010000:00010000:0.0:1788664117.340758:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c40153b200/0xcd11f61c1413d3dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d3d6 expref: 20 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664117.340784:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788664117.340792:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+20:3638:x1875550140386048:12345-0@lo:103: 00010000:00010000:0.0:1788664117.340802:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664117.340807:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d415 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d40e expref: 20 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.340817:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d415 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d40e expref: 20 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664117.341456:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664117.341483:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43518f0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788664117.341504:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4351efe00/0xcd11f61c1413d454 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d44d expref: 20 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664117.341518:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140385152:0@lo:104: 00010000:00010000:2.0:1788664117.341529:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d431 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d42a expref: 19 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664117.341537:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140385280:0@lo:104: 00000100:00100000:2.0:1788664117.341545:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140385408:0@lo:104: 00000100:00100000:2.0:1788664117.341552:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140385792:0@lo:104: 00000100:00100000:3.0:1788664117.341604:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140385920 00000100:00100000:3.0:1788664117.341609:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140385920 00000100:00100000:3.0:1788664117.341636:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788664117.341644:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:6506:x1875550140385920:12345-0@lo:104: 00010000:00010000:3.0:1788664117.341656:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4029e2e00/0xcd11f61c1413d35f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d366 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.341720:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788664117.341727:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:6506:x1875550140385920:12345-0@lo:104: Request processed in 84us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664117.341733:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788664117.341885:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875550140385920:0@lo:104: 00010000:00010000:3.0:1788664117.344423:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664117.344436:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4029e2e00/0xcd11f61c1413d35f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d366 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.344447:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2e00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1788664117.344451:0:7453:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2e00/0xcd11f61c1413d35f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d366 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.344460:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4029e2e00/0xcd11f61c1413d35f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d366 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664117.344468:0:7453:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2e00/0xcd11f61c1413d35f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d366 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664117.344474:0:7453:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788664117.344521:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4029e2e00/0xcd11f61c1413d35f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d366 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.344541:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788664117.344567:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2e00/0xcd11f61c1413d35f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d366 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.344574:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4029e2e00/0xcd11f61c1413d35f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d366 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.344593:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664117.344595:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664117.344597:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664117.344623:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788664117.344632:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788664117.344925:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664117.345149:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d49a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.345195:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d415 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d40e expref: 18 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.345210:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664117.345238:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140386304:0@lo:103: 00000100:00100000:0.0:1788664117.345312:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.345365:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788664117.345375:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140386304 00000100:00100000:0.0:1788664117.345380:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140386304 00010000:00010000:0.0:1788664117.345405:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c400030c00/0xcd11f61c1413d366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d35f expref: 18 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664117.345422:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788664117.345431:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664117.345438:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+18:3638:x1875550140386176:12345-0@lo:103: 00010000:00010000:0.0:1788664117.345450:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664117.345456:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c40153b200/0xcd11f61c1413d3dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d3d6 expref: 18 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.345467:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c40153b200/0xcd11f61c1413d3dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d3d6 expref: 18 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.345477:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40153b200/0xcd11f61c1413d3dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d3d6 expref: 18 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.345485:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664117.345565:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+17:3638:x1875550140386176:12345-0@lo:103: Request processed in 126us (4883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664117.345572:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664117.345588:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788664117.345594:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664117.345599:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c412c73c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+16:3636:x1875550140386304:12345-0@lo:103: 00010000:00010000:0.0:1788664117.345607:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664117.345611:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c400030c00/0xcd11f61c1413d366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d35f expref: 16 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.345628:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c400030c00/0xcd11f61c1413d366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d35f expref: 16 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.345637:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c400030c00/0xcd11f61c1413d366 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d35f expref: 16 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.345647:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d49a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.345654:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d49a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.345667:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d49a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.345673:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d49a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.345679:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d49a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.345685:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d49a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.345690:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ca00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664117.345708:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d49a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.345716:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d49a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664117.345850:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140386176:0@lo:103: 00010000:00010000:3.0:1788664117.346359:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d49a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.346369:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d49a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788664117.346378:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1788664117.346459:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d49a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.346469:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d49a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.346483:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664117.346533:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c412c73c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+15:3636:x1875550140386304:12345-0@lo:103: Request processed in 933us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664117.346541:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788664117.346568:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664117.346711:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+14:3638:x1875550140386048:12345-0@lo:103: Request processed in 5919us (6087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664117.346719:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788664117.347610:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140386048:0@lo:103: 00000100:00100000:1.0:1788664117.350559:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140386304:0@lo:103: 00000100:00100000:3.0:1788664117.354586:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+13:8420:x1875550140385024:12345-0@lo:253: Request processed in 35099us (37143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664117.354601:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788664117.355567:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140385024:0@lo:253: 10000000:01000000:1.0:1788664117.355585:0:8420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788664117.355589:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788664117.355590:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788664117.355592:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664117.355593:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788664117.355595:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664117.355596:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664117.355597:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664117.355612:0:8420:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788664117.355614:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664117.355615:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788664117.356011:0:8420:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c42f78b000 from lustre-OST0000 10000000:01000000:0.0:1788664117.356052:0:8420:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788664117.356055:0:8420:0:(mgc_request.c:327:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788664117.356064:0:8420:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93c422744d40 local copy 10000000:01000000:0.0:1788664117.356068:0:8420:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788664117.356162:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d4a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.356174:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d4a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.356184:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d4a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664117.356202:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140386432:0@lo:101: 00000100:00100000:0.0:1788664117.356255:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.356431:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411429180 going to sleep for 11 seconds 00000100:00100000:1.0:1788664117.356466:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140386432 00000100:00100000:1.0:1788664117.356472:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140386432 00000100:00100000:1.0:1788664117.356539:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788664117.356547:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+13:8420:x1875550140386432:12345-0@lo:101: 00010000:00010000:1.0:1788664117.356560:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664117.356571:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d4a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d4a1 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.356592:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d4a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d4a1 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.356602:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d4a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d4a1 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.356611:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e2600, rc 0) 00000100:00100000:1.0:1788664117.356648:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+14:8420:x1875550140386432:12345-0@lo:101: Request processed in 102us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664117.356654:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788664117.356716:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140386432:0@lo:101: 00010000:00010000:0.0:1788664117.356728:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d4a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcd11f61c1413d4a8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.356737:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d4a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd11f61c1413d4a8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664117.356858:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140386560:0@lo:501: 00000100:00100000:0.0:1788664117.356894:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.357141:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411429180 going to sleep for 11 seconds 00000100:00100000:2.0:1788664117.357269:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140386560 00000100:00100000:2.0:1788664117.357289:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140386560 00000100:00100000:2.0:1788664117.357313:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788664117.357322:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+14:8420:x1875550140386560:12345-0@lo:501: 00000100:00100000:2.0:1788664117.357405:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+14:8420:x1875550140386560:12345-0@lo:501: Request processed in 85us (510us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788664117.357413:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788664117.357481:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140386560:0@lo:501: 10000000:01000000:0.0:1788664117.357494:0:8420:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788664117.357513:0:8420:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788664117.357518:0:8420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d4a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd11f61c1413d4a8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.357526:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d4a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd11f61c1413d4a8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.357533:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd11f61c1413d4a8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.357558:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788664117.357582:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c42f78b000 10000000:01000000:0.0:1788664117.357587:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788664117.357593:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788664117.357601:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788664117.357605:0:8420:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788664117.357607:0:8420:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788664117.357625:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400030a00/0xcd11f61c1413d4af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.357631:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c400030a00/0xcd11f61c1413d4af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.357639:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c400030a00/0xcd11f61c1413d4af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664117.357651:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140386688:0@lo:101: 00000100:00100000:0.0:1788664117.357678:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.357690:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411429000 going to sleep for 11 seconds 00000100:00100000:2.0:1788664117.358088:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140386688 00000100:00100000:2.0:1788664117.358093:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140386688 00000100:00100000:2.0:1788664117.358116:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788664117.358122:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+14:8420:x1875550140386688:12345-0@lo:101: 00010000:00010000:2.0:1788664117.358130:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664117.358141:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0d600/0xcd11f61c1413d4b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d4af expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.358158:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0d600/0xcd11f61c1413d4b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d4af expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.358167:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0d600/0xcd11f61c1413d4b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d4af expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.358174:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d600, rc 0) 00000100:00100000:2.0:1788664117.358218:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:8420:x1875550140386688:12345-0@lo:101: Request processed in 95us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664117.358224:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:2.0:1788664117.358248:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664117.358254:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd11f61c1413d4a8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.358261:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664117.358271:0:7453:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd11f61c1413d4a8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.358291:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcd11f61c1413d4a8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664117.358298:0:7453:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcd11f61c1413d4a8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664117.358304:0:7453:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664117.358323:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d4a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd11f61c1413d4a8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.358328:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664117.358357:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d4a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd11f61c1413d4a8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.358364:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d4a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd11f61c1413d4a8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.358378:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664117.358379:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664117.358381:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664117.358391:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140386816:0@lo:103: 00000100:00100000:2.0:1788664117.358422:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664117.358462:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140386816 00000100:00100000:2.0:1788664117.358466:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140386816 00000100:00100000:2.0:1788664117.358497:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664117.358505:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+15:3637:x1875550140386816:12345-0@lo:103: 00010000:00010000:2.0:1788664117.358513:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664117.358532:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d4a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d4a1 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.358541:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664117.358568:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+14:3637:x1875550140386816:12345-0@lo:103: Request processed in 65us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664117.358574:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664117.358603:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140386816:0@lo:103: 00000100:00100000:0.0:1788664117.358741:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140386688:0@lo:101: 00010000:00010000:0.0:1788664117.358754:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c400030a00/0xcd11f61c1413d4af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d4b6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.358762:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c400030a00/0xcd11f61c1413d4af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d4b6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664117.358893:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140386944:0@lo:501: 00000100:00100000:0.0:1788664117.358923:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.358937:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411429000 going to sleep for 11 seconds 00000100:00100000:1.0:1788664117.359508:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140386944 00000100:00100000:1.0:1788664117.359515:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140386944 00000100:00100000:0.0:1788664117.359840:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788664117.359850:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+14:8420:x1875550140386944:12345-0@lo:501: 00000100:00100000:0.0:1788664117.360245:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+14:8420:x1875550140386944:12345-0@lo:501: Request processed in 396us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664117.360264:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788664117.360469:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140386944:0@lo:501: 00000100:00100000:1.0:1788664117.360514:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387072:0@lo:503: 00000100:00100000:1.0:1788664117.360564:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664117.360598:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664117.361209:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140387072 00000100:00100000:2.0:1788664117.361215:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140387072 00000100:00100000:2.0:1788664117.361259:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788664117.361267:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+14:8420:x1875550140387072:12345-0@lo:503: 00000100:00100000:0.0:1788664117.362215:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+14:8420:x1875550140387072:12345-0@lo:503: Request processed in 945us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664117.362224:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788664117.362706:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387072:0@lo:503: 00000040:00080000:1.0:1788664117.363029:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788664117.363135:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387200:0@lo:502: 00000100:00100000:1.0:1788664117.363190:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664117.363234:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664117.364025:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140387200 00000100:00100000:3.0:1788664117.364033:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140387200 00000100:00100000:3.0:1788664117.364094:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788664117.364103:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+14:8420:x1875550140387200:12345-0@lo:502: 00000100:00100000:3.0:1788664117.364237:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+14:8420:x1875550140387200:12345-0@lo:502: Request processed in 134us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664117.364245:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788664117.364511:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387200:0@lo:502: 00000040:00080000:0.0:1788664117.365202:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788664117.365245:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788664117.365263:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788664117.365276:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788664117.365371:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788664117.365389:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788664117.365426:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387328:0@lo:502: 00000100:00100000:0.0:1788664117.365484:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.365529:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406383a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664117.365592:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140387328 00000100:00100000:2.0:1788664117.365599:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140387328 00000100:00100000:2.0:1788664117.365674:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788664117.365684:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+14:8420:x1875550140387328:12345-0@lo:502: 00000100:00100000:2.0:1788664117.366538:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+14:8420:x1875550140387328:12345-0@lo:502: Request processed in 854us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664117.366547:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788664117.366623:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387328:0@lo:502: 00000040:00080000:1.0:1788664117.366686:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788664117.366842:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788664117.367567:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788664117.367575:0:8444:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788664117.367583:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664117.367585:0:8444:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788664117.367590:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788664117.367605:0:8444:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93c42e864d40) 00000020:00000080:2.0:1788664117.367628:0:8444:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788664117.367634:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788664117.369151:0:8444:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c42f78b000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788664117.369167:0:8444:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788664117.369178:0:8444:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd11f61c1413d4c4 00010000:00010000:0.0:1788664117.376545:0:8444:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1788664117.378044:0:8444:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788664117.386495:0:8444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788664117.389569:0:8444:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788664117.394816:0:8444:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788664117.395054:0:8444:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788664117.405672:0:8444:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788664117.407858:0:8444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788664117.407872:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664117.407884:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664117.407886:0:8444:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788664117.407890:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664117.407894:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664117.407895:0:8444:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788664117.407898:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788664117.407900:0:8444:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788664117.408044:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664117.408049:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664117.408051:0:8444:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788664117.408054:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788664117.408371:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788664117.408402:0:8420:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788664117.408426:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400030a00/0xcd11f61c1413d4af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d4b6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.408439:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c400030a00/0xcd11f61c1413d4af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d4b6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664117.408447:0:8420:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c42f78b000 from 1 10000000:01000000:1.0:1788664117.408450:0:8420:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664117.408488:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e3200/0xcd11f61c1413d4cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.408496:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4029e3200/0xcd11f61c1413d4cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.408509:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4029e3200/0xcd11f61c1413d4cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664117.408535:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387456:0@lo:101: 00000100:00100000:1.0:1788664117.408610:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664117.408664:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086840 going to sleep for 11 seconds 00000100:00100000:2.0:1788664117.408978:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140387456 00000100:00100000:2.0:1788664117.408987:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140387456 00000100:00100000:2.0:1788664117.409025:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788664117.409033:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+14:8420:x1875550140387456:12345-0@lo:101: 00010000:00010000:2.0:1788664117.409044:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664117.409057:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0de00/0xcd11f61c1413d4d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d4cb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.409351:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0de00/0xcd11f61c1413d4d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d4cb expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.409365:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0de00/0xcd11f61c1413d4d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d4cb expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664117.409374:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0de00, rc 0) 00000100:00100000:2.0:1788664117.409429:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:8420:x1875550140387456:12345-0@lo:101: Request processed in 396us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664117.409436:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788664117.409535:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387456:0@lo:101: 00010000:00010000:1.0:1788664117.409553:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4029e3200/0xcd11f61c1413d4cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d4d2 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.409562:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4029e3200/0xcd11f61c1413d4cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d4d2 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664117.409661:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387584:0@lo:501: 00000100:00100000:1.0:1788664117.409693:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664117.409726:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086840 going to sleep for 11 seconds 00000100:00100000:2.0:1788664117.409796:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140387584 00000100:00100000:2.0:1788664117.409801:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140387584 00000100:00100000:2.0:1788664117.409893:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788664117.409901:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:8420:x1875550140387584:12345-0@lo:501: 00000100:00100000:2.0:1788664117.410007:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:8420:x1875550140387584:12345-0@lo:501: Request processed in 107us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664117.410014:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788664117.410105:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387584:0@lo:501: 00000100:00100000:1.0:1788664117.410131:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387712:0@lo:503: 00000100:00100000:1.0:1788664117.410170:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664117.416657:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086840 going to sleep for 11 seconds 00000100:00100000:3.0:1788664117.419875:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140387712 00000100:00100000:3.0:1788664117.419891:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140387712 00000100:00100000:3.0:1788664117.419959:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788664117.419969:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:8420:x1875550140387712:12345-0@lo:503: 00000100:00100000:3.0:1788664117.420695:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:8420:x1875550140387712:12345-0@lo:503: Request processed in 725us (10521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664117.420705:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788664117.420900:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387712:0@lo:503: 00000040:00080000:1.0:1788664117.421681:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788664117.421815:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387840:0@lo:502: 00000100:00100000:1.0:1788664117.422175:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664117.422263:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086840 going to sleep for 11 seconds 00000100:00100000:2.0:1788664117.423720:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140387840 00000100:00100000:2.0:1788664117.423732:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140387840 00000100:00100000:3.0:1788664117.425570:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788664117.425593:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:8420:x1875550140387840:12345-0@lo:502: 00000100:00100000:3.0:1788664117.426646:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:8420:x1875550140387840:12345-0@lo:502: Request processed in 1059us (4466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664117.426657:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788664117.427730:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387840:0@lo:502: 00000040:00080000:1.0:1788664117.428381:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788664117.428414:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788664117.428454:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387968:0@lo:502: 00000100:00100000:1.0:1788664117.428528:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664117.428610:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086840 going to sleep for 11 seconds 00000100:00100000:2.0:1788664117.428655:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140387968 00000100:00100000:2.0:1788664117.428662:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140387968 00000100:00100000:2.0:1788664117.429006:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788664117.429018:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:8420:x1875550140387968:12345-0@lo:502: 00000100:00100000:2.0:1788664117.429170:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:8420:x1875550140387968:12345-0@lo:502: Request processed in 156us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664117.429178:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788664117.429260:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140387968:0@lo:502: 00000040:00080000:1.0:1788664117.429334:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788664117.429345:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788664117.432526:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664117.432539:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664117.432541:0:8448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788664117.432548:0:8448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c42f78b000 00000020:00000080:1.0:1788664117.432550:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788664117.432561:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664117.432563:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664117.432565:0:8448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788664117.432567:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788664117.432708:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788664117.432740:0:8420:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788664117.432766:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e3200/0xcd11f61c1413d4cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d4d2 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.432801:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e3200/0xcd11f61c1413d4cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d4d2 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664117.432877:0:8420:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788664117.432880:0:8420:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff93c42f78b000 10000000:01000000:0.0:1788664117.432883:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c42f78b000 10000000:01000000:0.0:1788664117.432887:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788664117.432893:0:8420:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c42f78b000 from 1 10000000:01000000:0.0:1788664117.432896:0:8420:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788664117.432935:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400030c00/0xcd11f61c1413d4d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.432944:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c400030c00/0xcd11f61c1413d4d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.432954:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c400030c00/0xcd11f61c1413d4d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664117.432978:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140388096:0@lo:101: 00000100:00100000:0.0:1788664117.433048:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.433560:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406383a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664117.433630:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140388096 00000100:00100000:3.0:1788664117.433638:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140388096 00000100:00100000:3.0:1788664117.433681:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788664117.433691:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:8420:x1875550140388096:12345-0@lo:101: 00010000:00010000:3.0:1788664117.433707:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664117.433723:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4351eea00/0xcd11f61c1413d4e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d4d9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.433749:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4351eea00/0xcd11f61c1413d4e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d4d9 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.433762:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4351eea00/0xcd11f61c1413d4e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d4d9 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.433845:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351eea00, rc 0) 00000100:00100000:3.0:1788664117.434050:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:8420:x1875550140388096:12345-0@lo:101: Request processed in 359us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664117.434080:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788664117.434407:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140388096:0@lo:101: 00010000:00010000:1.0:1788664117.434427:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c400030c00/0xcd11f61c1413d4d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d4e0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.434437:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c400030c00/0xcd11f61c1413d4d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d4e0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664117.434561:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140388224:0@lo:501: 00000100:00100000:1.0:1788664117.434603:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664117.434675:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086540 going to sleep for 11 seconds 00000100:00100000:3.0:1788664117.434712:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140388224 00000100:00100000:3.0:1788664117.434717:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140388224 00000100:00100000:3.0:1788664117.435062:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788664117.435081:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:8420:x1875550140388224:12345-0@lo:501: 00000100:00100000:3.0:1788664117.435363:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:8420:x1875550140388224:12345-0@lo:501: Request processed in 291us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664117.435371:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788664117.435501:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140388224:0@lo:501: 00000100:00100000:0.0:1788664117.435536:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140388352:0@lo:503: 00000100:00100000:0.0:1788664117.435584:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.435617:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406383a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664117.435661:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140388352 00000100:00100000:1.0:1788664117.435667:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140388352 00000100:00100000:1.0:1788664117.435706:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788664117.435714:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:8420:x1875550140388352:12345-0@lo:503: 00000100:00100000:1.0:1788664117.436068:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:8420:x1875550140388352:12345-0@lo:503: Request processed in 355us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664117.436142:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788664117.436241:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140388352:0@lo:503: 00000040:00080000:0.0:1788664117.436494:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788664117.436586:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140388480:0@lo:502: 00000100:00100000:0.0:1788664117.436627:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.436669:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c419b26f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664117.436844:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140388480 00000100:00100000:2.0:1788664117.436850:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140388480 00000100:00100000:2.0:1788664117.436881:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788664117.436889:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:8420:x1875550140388480:12345-0@lo:502: 00000100:00100000:2.0:1788664117.437626:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:8420:x1875550140388480:12345-0@lo:502: Request processed in 735us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664117.437634:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788664117.438278:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140388480:0@lo:502: 00000040:00080000:0.0:1788664117.438583:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788664117.438615:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788664117.438629:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788664117.438641:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788664117.438654:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788664117.438682:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788664117.438697:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788664117.438709:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788664117.438721:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788664117.438732:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788664117.438744:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788664117.438756:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788664117.438767:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788664117.440535:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788664117.440552:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788664117.440565:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788664117.440577:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788664117.440590:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788664117.440602:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788664117.440615:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788664117.440628:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788664117.440667:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788664117.440683:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788664117.440696:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788664117.440709:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788664117.440721:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788664117.440733:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788664117.440745:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788664117.440757:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788664117.447517:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788664117.447623:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788664117.447643:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788664117.447660:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788664117.447675:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788664117.447690:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788664117.447703:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788664117.447718:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1788664117.447797:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e979180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140388608:0@lo:502: 00000100:00100000:1.0:1788664117.448410:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664117.448478:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664117.448515:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140388608 00000100:00100000:2.0:1788664117.448523:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140388608 00000100:00100000:2.0:1788664117.448604:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788664117.448614:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:8420:x1875550140388608:12345-0@lo:502: 00000100:00100000:2.0:1788664117.448764:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:8420:x1875550140388608:12345-0@lo:502: Request processed in 151us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664117.449557:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e979180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140388608:0@lo:502: 00000040:00080000:3.0:1788664117.449640:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788664117.449653:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000100:00100000:2.0:1788664117.450064:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000020:01000004:3.0:1788664117.451216:0:8449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788664117.451236:0:8449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93c4353719c0) 00000020:00000080:3.0:1788664117.451261:0:8449:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788664117.451372:0:8449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c42f78b000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788664117.451376:0:8449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c42f78b000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788664117.451378:0:8449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c42f78b000 3 00010000:00080000:3.0:1788664117.451414:0:8449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c30257d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788664117.457723:0:8449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1788664117.458240:0:8449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788664117.458297:0:8449:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788664117.458309:0:8449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcd11f61c1413d4ee 00000100:00080000:3.0:1788664117.458319:0:8449:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788664117.458326:0:8449:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93c30257d800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788664117.458372:0:8449:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c42d9a8000 x1875550140388736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788664117.458390:0:8449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788664117.458620:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1875550140388736:0@lo:38: 00000100:00100000:2.0:1788664117.458688:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.458948:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140388992:0@lo:400: 00000100:00100000:0.0:1788664117.458985:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.459007:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788664117.459013:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140388864:0@lo:400: 00000100:00100000:0.0:1788664117.459034:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.459063:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140388736 00000100:00100000:0.0:1788664117.459081:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140388736 00000100:00100000:0.0:1788664117.459102:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140388992 00000100:00100000:0.0:1788664117.459104:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140388992 00000100:00100000:0.0:1788664117.459123:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140388864 00000100:00100000:0.0:1788664117.459125:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140388864 00000100:00100000:0.0:1788664117.459141:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664117.459149:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140388992:12345-0@lo:400: 00000100:00100000:0.0:1788664117.459200:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140388992:12345-0@lo:400: Request processed in 51us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664117.459207:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664117.459222:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664117.459228:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140388864:12345-0@lo:400: 00000100:00100000:0.0:1788664117.459257:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140388864:12345-0@lo:400: Request processed in 29us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664117.459263:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664117.459275:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664117.459292:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1875550140388736:12345-0@lo:38: 00010000:00080000:0.0:1788664117.459313:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:0.0:1788664117.459355:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcd11f61c1413d4f5 00000004:00100000:0.0:1788664117.459369:0:6512:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788664117.459399:0:6512:0:(import.c:65:import_set_state_nolock()) ffff93c30256f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788664117.459435:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875550140388736:12345-0@lo:38: Request processed in 141us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664117.459447:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788664117.459488:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c42f5e5c00 x1875550140388864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664117.459500:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140388864:0@lo:400: 00010000:00080000:0.0:1788664117.459509:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c42f5e7800 x1875550140388992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664117.459517:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140388992:0@lo:400: 00000100:00100000:2.0:1788664117.460623:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140389120:0@lo:400: 00000100:00100000:2.0:1788664117.460681:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664117.460736:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140389120 00000100:00100000:2.0:1788664117.460742:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140389120 00000100:00100000:2.0:1788664117.460799:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788664117.460808:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140389120:12345-0@lo:400: 00000100:00100000:2.0:1788664117.460870:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140389120:12345-0@lo:400: Request processed in 64us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664117.460878:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788664117.460916:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140389120:0@lo:400: 00010000:00080000:2.0:1788664117.460961:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c42d9a8000 x1875550140388736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664117.460971:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788664117.460981:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788664117.460989:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788664117.460993:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788664117.460997:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c30257d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788664117.461003:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1875550140388736:0@lo:38: 00000020:01000004:3.0:1788664117.461297:0:8449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788664117.461315:0:8449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff93c435370000) 00000020:00000080:3.0:1788664117.461337:0:8449:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1788664117.461417:0:8449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c42f78b000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788664117.461421:0:8449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c42f78b000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788664117.461423:0:8449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c42f78b000 3 00010000:00080000:3.0:1788664117.461452:0:8449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c302578000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788664117.466402:0:8449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1788664117.466601:0:8449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788664117.466646:0:8449:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788664117.466658:0:8449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xcd11f61c1413d503 00000100:00080000:3.0:1788664117.466669:0:8449:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788664117.466677:0:8449:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93c302578000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788664117.466710:0:8449:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c42d9a9500 x1875550140389248/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664117.466807:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1875550140389248:0@lo:38: 00000100:00100000:2.0:1788664117.466897:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.467811:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140389248 00000100:00100000:0.0:1788664117.467836:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140389248 00000100:00100000:0.0:1788664117.467881:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664117.467889:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1875550140389248:12345-0@lo:38: 00010000:00080000:0.0:1788664117.467919:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:0.0:1788664117.467966:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xcd11f61c1413d50a 00000004:00100000:0.0:1788664117.467984:0:6512:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788664117.468018:0:6512:0:(import.c:65:import_set_state_nolock()) ffff93c30256d000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788664117.468303:0:8449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788664117.473763:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875550140389248:12345-0@lo:38: Request processed in 5863us (6855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664117.473797:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788664117.474427:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c42d9a9500 x1875550140389248/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664117.474446:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788664117.474456:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788664117.474464:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788664117.474469:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788664117.474472:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c302578000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788664117.474478:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1875550140389248:0@lo:38: 00000040:00080000:3.0:1788664117.478529:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788664117.479518:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788664117.479556:0:8420:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788664117.479583:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400030c00/0xcd11f61c1413d4d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d4e0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664117.479596:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c400030c00/0xcd11f61c1413d4d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d4e0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788664117.479663:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788664117.479665:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788664117.479667:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664117.479668:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788664117.479669:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664117.479670:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664117.479672:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788664117.479673:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788664117.479675:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788664117.479677:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664117.479678:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788664117.479681:0:8420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788664117.479684:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788664117.479685:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788664117.479686:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664117.479688:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788664117.479689:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664117.479689:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664117.479690:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788664117.479691:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788664117.479692:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788664117.479693:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664117.479694:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788664117.479720:0:8420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788664117.479742:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140389376:0@lo:253: 00000100:00100000:0.0:1788664117.483212:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664117.483259:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406383a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664117.484194:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140389376 00000100:00100000:3.0:1788664117.484206:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140389376 00000100:00100000:3.0:1788664117.484267:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788664117.484276:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:8420:x1875550140389376:12345-0@lo:253: 20000000:01000000:3.0:1788664117.484389:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788664117.484402:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788664117.491610:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788664117.491633:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788664117.491895:0:6527:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788664117.491900:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788664117.491932:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d511 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.491951:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c40153a800/0xcd11f61c1413d407 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d400 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.491959:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d423 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d41c expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.491966:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d511 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.492005:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d41c expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.492019:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d423 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d41c expref: 16 pid: 6505 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664117.492034:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e978e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875550140389504:0@lo:104: 00000100:00100000:1.0:1788664117.492126:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664117.492174:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c40153a800/0xcd11f61c1413d407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d400 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.492184:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c40153a800/0xcd11f61c1413d407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d400 expref: 16 pid: 6505 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664117.492193:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e979500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875550140389632:0@lo:104: 00000100:00100000:1.0:1788664117.492212:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664117.492586:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788664117.492606:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664117.492639:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140389504 00000100:00100000:3.0:1788664117.492647:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140389504 00000100:00100000:3.0:1788664117.492698:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140389632 00000100:00100000:3.0:1788664117.492701:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140389632 00000100:00100000:3.0:1788664117.492727:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788664117.492735:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43527f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:6527:x1875550140389504:12345-0@lo:104: 00010000:00010000:3.0:1788664117.492747:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d41c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d423 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.492837:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788664117.492843:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43527f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:6527:x1875550140389504:12345-0@lo:104: Request processed in 110us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664117.492850:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788664117.492889:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788664117.492895:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:6527:x1875550140389632:12345-0@lo:104: 00010000:00010000:3.0:1788664117.492903:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.492949:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788664117.492954:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:6527:x1875550140389632:12345-0@lo:104: Request processed in 60us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664117.492960:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788664117.492978:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788664117.492984:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d41c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d423 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.492991:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40153a600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1788664117.492994:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d41c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d423 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.493002:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d41c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d423 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664117.493020:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d41c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d423 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664117.493026:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788664117.493056:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d41c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d423 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.493063:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788664117.493311:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e978e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875550140389504:0@lo:104: 00000100:00100000:0.0:1788664117.493323:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e979500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875550140389632:0@lo:104: 00010000:00010000:0.0:1788664117.493343:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d511 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664117.493420:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:8420:x1875550140389376:12345-0@lo:253: Request processed in 9145us (10216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664117.493429:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788664117.493470:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:8420:1875550140389376:0@lo:253: 10000000:01000000:0.0:1788664117.493481:0:8420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788664117.493484:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788664117.493485:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788664117.493487:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664117.493487:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788664117.493489:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664117.493490:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664117.493491:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788664117.493493:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788664117.493494:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788664117.493496:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664117.493498:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788664117.493508:0:8420:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788664117.494154:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d41c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d423 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.494166:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d41c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d423 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.494182:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664117.494186:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.494193:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1788664117.494196:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.494205:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664117.494211:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664117.494217:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788664117.494252:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d400 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.494259:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788664117.494276:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d400 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.494283:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d400 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.494298:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664117.494300:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664117.494302:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664117.494312:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664117.494327:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140389888:0@lo:103: 00000100:00100000:3.0:1788664117.494368:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664117.494408:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140389888 00000100:00100000:3.0:1788664117.494414:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140389888 00010000:00010000:3.0:1788664117.494436:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c40153a800/0xcd11f61c1413d407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d400 expref: 16 pid: 6505 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664117.494465:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788664117.494473:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+16:3639:x1875550140389888:12345-0@lo:103: 00010000:00010000:3.0:1788664117.494485:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664117.494490:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c40153a800/0xcd11f61c1413d407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d400 expref: 16 pid: 6505 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.494498:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c40153a800/0xcd11f61c1413d407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d400 expref: 16 pid: 6505 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.494514:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40153a800/0xcd11f61c1413d407 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d400 expref: 16 pid: 6505 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664117.494533:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664117.494565:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+15:3639:x1875550140389888:12345-0@lo:103: Request processed in 93us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664117.494572:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788664117.496032:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664117.496059:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140389760:0@lo:103: 00000100:00100000:2.0:1788664117.496119:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664117.496517:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140389760 00000100:00100000:1.0:1788664117.496526:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140389760 00010000:00010000:1.0:1788664117.496557:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d423 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d41c expref: 15 pid: 6505 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664117.496593:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788664117.496602:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+15:3637:x1875550140389760:12345-0@lo:103: 00010000:00010000:1.0:1788664117.496615:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664117.496620:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d423 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d41c expref: 15 pid: 6505 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.496631:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d41c expref: 15 pid: 6505 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.496646:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d423 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d41c expref: 15 pid: 6505 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.496662:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d511 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.496670:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d511 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788664117.496698:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004798932s 00010000:00010000:1.0:1788664117.496703:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d511 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.496711:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d511 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.496717:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d511 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.496723:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d511 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.496729:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2600 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664117.496733:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d511 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.496740:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d511 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.496758:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d511 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.496786:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664117.496839:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+14:3637:x1875550140389760:12345-0@lo:103: Request processed in 238us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664117.496847:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788664117.496872:0:6527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d511 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.496891:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d511 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664117.496899:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d511 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664117.498091:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140389760:0@lo:103: 00000100:00100000:2.0:1788664117.498364:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140389888:0@lo:103: 00080000:10000000:0.0:1788664117.514492:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788664117.514658:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788664117.516494:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788664117.516695:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788664117.518988:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788664117.522645:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788664117.526740:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788664117.555423:0:8420:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788664117.555434:0:8420:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788664117.555471:0:8420:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788664117.555517:0:8420:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788664117.555542:0:8420:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788664117.555563:0:8420:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788664117.556640:0:8420:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788664117.556858:0:8420:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788664117.709752:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788664118.689671:0:8505:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788664118.689960:0:8505:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788664118.723143:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664119.742343:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664120.765917:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664120.894045:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664120.894080:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140390016:0@lo:41: 00000100:00100000:0.0:1788664120.894159:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664120.894232:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140390016 00000100:00100000:3.0:1788664120.894241:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140390016 00000100:00100000:3.0:1788664120.894284:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788664120.894294:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140390016:12345-0@lo:41: 00000004:00000024:3.0:1788664120.894336:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788664120.894399:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140390016:12345-0@lo:41: Request processed in 106us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664120.894406:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788664120.895946:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140390016:0@lo:41: 00010000:00010000:3.0:1788664121.790012:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788664122.431532:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788664122.431540:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c42d99f800 from 30 10000000:01000000:2.0:1788664122.431546:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:0.0:1788664122.431757:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664122.431913:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140390272:0@lo:41: 00000100:00100000:0.0:1788664122.431983:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664122.432192:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140390272 00000100:00100000:0.0:1788664122.432200:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140390272 00000100:00100000:0.0:1788664122.432253:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788664122.432262:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140390272:12345-0@lo:41: 00000004:00000024:0.0:1788664122.432296:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1788664122.432345:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140390272:12345-0@lo:41: Request processed in 85us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664122.432352:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788664122.432488:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140390272:0@lo:41: 00010000:00010000:2.0:1788664122.432553:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0d800/0xcd11f61c1413d518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.432564:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c402a0d800/0xcd11f61c1413d518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.432574:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c402a0d800/0xcd11f61c1413d518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664122.432855:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140390144:0@lo:101: 00000100:00100000:2.0:1788664122.432891:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664122.432934:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43518f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788664122.433496:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140390144 00000100:00100000:0.0:1788664122.433502:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140390144 00000100:00100000:0.0:1788664122.433548:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788664122.433557:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+14:6508:x1875550140390144:12345-0@lo:101: 00010000:00010000:0.0:1788664122.433571:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664122.433696:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c400030400/0xcd11f61c1413d51f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d518 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.433722:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c400030400/0xcd11f61c1413d51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d518 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.433745:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c400030400/0xcd11f61c1413d51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d518 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.433754:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400030400, rc 0) 00000100:00100000:0.0:1788664122.433901:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140390144:12345-0@lo:101: Request processed in 344us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664122.433908:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788664122.433979:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140390144:0@lo:101: 00010000:00010000:2.0:1788664122.433995:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c402a0d800/0xcd11f61c1413d518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d51f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.434005:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c402a0d800/0xcd11f61c1413d518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d51f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664122.434084:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140390400:0@lo:501: 00000100:00100000:2.0:1788664122.434114:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664122.434144:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43518f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788664122.434241:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140390400 00000100:00100000:0.0:1788664122.434247:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140390400 00000100:00100000:0.0:1788664122.434280:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788664122.434288:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140390400:12345-0@lo:501: 00000100:00100000:0.0:1788664122.434529:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140390400:12345-0@lo:501: Request processed in 242us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664122.434536:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788664122.434657:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140390400:0@lo:501: 00000100:00100000:2.0:1788664122.434683:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140390528:0@lo:503: 00000100:00100000:2.0:1788664122.434723:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664122.434746:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43518f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788664122.434886:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140390528 00000100:00100000:0.0:1788664122.434891:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140390528 00000100:00100000:0.0:1788664122.434952:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788664122.434960:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140390528:12345-0@lo:503: 00000100:00100000:0.0:1788664122.435057:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140390528:12345-0@lo:503: Request processed in 98us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664122.435064:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788664122.442137:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140390528:0@lo:503: 00000100:00100000:1.0:1788664122.443905:0:8668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8668:1875550140390656:0@lo:502: 00000100:00100000:1.0:1788664122.443991:0:8668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664122.444033:0:8668:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4126d1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664122.444356:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140390656 00000100:00100000:0.0:1788664122.444364:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140390656 00000100:00100000:0.0:1788664122.444686:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788664122.444698:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:8668:x1875550140390656:12345-0@lo:502: 00000100:00100000:0.0:1788664122.444912:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:8668:x1875550140390656:12345-0@lo:502: Request processed in 217us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664122.444921:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788664122.445544:0:8668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8668:1875550140390656:0@lo:502: 00000100:00100000:3.0:1788664122.445681:0:8668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8668:1875550140390784:0@lo:502: 00000100:00100000:3.0:1788664122.445729:0:8668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664122.445762:0:8668:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4087a1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664122.446144:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140390784 00000100:00100000:0.0:1788664122.446150:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140390784 00000100:00100000:0.0:1788664122.446190:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788664122.446198:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:8668:x1875550140390784:12345-0@lo:502: 00000100:00100000:0.0:1788664122.446310:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:8668:x1875550140390784:12345-0@lo:502: Request processed in 112us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664122.446317:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788664122.446542:0:8668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8668:1875550140390784:0@lo:502: 00000040:00080000:3.0:1788664122.446566:0:8668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788664122.447024:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788664122.447679:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788664122.447692:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0d800/0xcd11f61c1413d518 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d51f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.447704:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c402a0d800/0xcd11f61c1413d518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d51f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664122.447713:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788664122.447715:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c42d99f800 from 5 10000000:01000000:0.0:1788664122.447718:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788664122.447753:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d526 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.447762:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d526 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.448175:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d526 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664122.448209:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140390912:0@lo:101: 00000100:00100000:0.0:1788664122.448265:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664122.448299:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c408731540 going to sleep for 11 seconds 00000100:00100000:1.0:1788664122.448517:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140390912 00000100:00100000:1.0:1788664122.448524:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140390912 00000100:00100000:1.0:1788664122.448567:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788664122.448576:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140390912:12345-0@lo:101: 00010000:00010000:1.0:1788664122.449229:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664122.449249:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4029e3600/0xcd11f61c1413d52d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d526 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664122.449276:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e3600/0xcd11f61c1413d52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d526 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664122.449287:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4029e3600/0xcd11f61c1413d52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d526 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664122.449296:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e3600, rc 0) 00000100:00100000:1.0:1788664122.449363:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140390912:12345-0@lo:101: Request processed in 788us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664122.449376:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788664122.449559:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140390912:0@lo:101: 00010000:00010000:2.0:1788664122.449575:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d526 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d52d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.449655:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d526 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d52d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664122.449717:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140391040:0@lo:256: 00000100:00100000:2.0:1788664122.449758:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664122.451456:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43518f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788664122.456476:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140391040 00000100:00100000:1.0:1788664122.456491:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140391040 00000100:00100000:1.0:1788664122.456663:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788664122.456676:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140391040:12345-0@lo:256: 20000000:01000000:1.0:1788664122.456703:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788664122.456723:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788664122.456726:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788664122.456886:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140391040:12345-0@lo:256: Request processed in 212us (7126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664122.456893:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788664122.456981:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140391040:0@lo:256: 10000000:01000000:3.0:1788664122.457034:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788664122.457054:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d526 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d52d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664122.457077:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d52d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664122.457085:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788664122.457088:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1788664122.457090:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788664122.457120:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d534 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664122.457128:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d534 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664122.457137:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d534 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664122.457156:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140391168:0@lo:101: 00000100:00100000:3.0:1788664122.457190:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664122.458825:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4087a1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664122.459007:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140391168 00000100:00100000:2.0:1788664122.459015:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140391168 00000100:00100000:2.0:1788664122.459073:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788664122.459082:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140391168:12345-0@lo:101: 00010000:00010000:2.0:1788664122.459096:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664122.459112:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d53b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d534 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.459138:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d53b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d534 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.459150:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d53b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d534 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.459159:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d200, rc 0) 00000100:00100000:2.0:1788664122.459216:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140391168:12345-0@lo:101: Request processed in 135us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664122.459223:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788664122.459344:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140391168:0@lo:101: 00010000:00010000:3.0:1788664122.459361:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d534 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d53b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664122.459371:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d534 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d53b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664122.459449:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140391296:0@lo:501: 00000100:00100000:3.0:1788664122.459481:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664122.459516:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4087a1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664122.459670:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140391296 00000100:00100000:2.0:1788664122.459675:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140391296 00000100:00100000:2.0:1788664122.459693:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788664122.459699:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c420ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140391296:12345-0@lo:501: 00000100:00100000:2.0:1788664122.459846:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c420ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140391296:12345-0@lo:501: Request processed in 145us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664122.459853:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788664122.459925:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140391296:0@lo:501: 00000100:00100000:3.0:1788664122.459951:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140391424:0@lo:503: 00000100:00100000:3.0:1788664122.459990:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664122.460051:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4087a1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788664122.460146:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140391424 00000100:00100000:1.0:1788664122.460151:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140391424 00000100:00100000:0.0:1788664122.460214:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788664122.460222:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c410474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140391424:12345-0@lo:503: 00000100:00100000:0.0:1788664122.460314:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c410474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140391424:12345-0@lo:503: Request processed in 92us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664122.460322:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788664122.460396:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140391424:0@lo:503: 00000100:00100000:3.0:1788664122.460565:0:8672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8672:1875550140391552:0@lo:502: 00000100:00100000:3.0:1788664122.460714:0:8672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664122.460906:0:8672:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4087a1180 going to sleep for 11 seconds 00000100:00100000:2.0:1788664122.460934:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140391552 00000100:00100000:2.0:1788664122.460939:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140391552 00000100:00100000:2.0:1788664122.460961:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788664122.460967:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c410475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:8672:x1875550140391552:12345-0@lo:502: 00000100:00100000:2.0:1788664122.461126:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c410475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:8672:x1875550140391552:12345-0@lo:502: Request processed in 158us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664122.461139:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788664122.461211:0:8672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8672:1875550140391552:0@lo:502: 00000020:01000000:3.0:1788664122.461235:0:8672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788664122.461242:0:8672:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788664122.461249:0:8672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664122.461251:0:8672:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788664122.461257:0:8672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788664122.461261:0:8672:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:3.0:1788664122.461281:0:8672:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788664122.461284:0:8672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788664122.461307:0:8672:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff93c3028dcd40) 00000020:00000080:3.0:1788664122.461329:0:8672:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788664122.461336:0:8672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788664122.461430:0:8672:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788664122.461437:0:8672:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788664122.461445:0:8672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd11f61c1413d549 00010000:00080000:3.0:1788664122.461475:0:8672:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c43675a000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788664122.461853:0:8672:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788664122.472298:0:8672:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788664122.472333:0:8672:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788664122.472538:0:8672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788664122.472890:0:8672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788664122.472977:0:8672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788664122.473214:0:8672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788664122.481246:0:8674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664122.481256:0:8674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788664122.492221:0:8672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788664122.492236:0:8672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788664122.492282:0:8672:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788664122.492305:0:8672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd11f61c1413d550 00000100:00080000:2.0:1788664122.492317:0:8672:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788664122.492323:0:8672:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93c43675a000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664122.492360:0:8672:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c301eab480 x1875550140391680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664122.492397:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140391680:0@lo:8: 00000100:00100000:2.0:1788664122.492476:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788664122.492531:0:8672:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788664122.492698:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140391680 00000100:00100000:1.0:1788664122.492706:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140391680 00000100:00100000:1.0:1788664122.492739:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664122.492746:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1875550140391680:12345-0@lo:8: 00010000:00080000:1.0:1788664122.492795:0:8426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:1.0:1788664122.492820:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd11f61c1413d557 00002000:00100000:1.0:1788664122.492850:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff93c42e859800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788664122.492854:0:8426:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1788664122.492857:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788664122.492912:0:8426:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:2.0:1788664122.494133:0:8672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664122.494144:0:8672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664122.494146:0:8672:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788664122.494154:0:8672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664122.494159:0:8672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664122.494160:0:8672:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788664122.494164:0:8672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788664122.494165:0:8672:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788664122.494202:0:8672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8672:1875550140391808:0@lo:502: 00000100:00100000:2.0:1788664122.494270:0:8672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664122.494309:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140391808 00000100:00100000:2.0:1788664122.494314:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140391808 00000100:00100000:2.0:1788664122.494356:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788664122.494365:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c421997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:8672:x1875550140391808:12345-0@lo:502: 00000100:00100000:2.0:1788664122.494476:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c421997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:8672:x1875550140391808:12345-0@lo:502: Request processed in 112us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664122.494484:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788664122.494530:0:8672:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406383780 going to sleep for 11 seconds 00000100:00100000:2.0:1788664122.494551:0:8672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8672:1875550140391808:0@lo:502: 00000020:01000000:2.0:1788664122.494575:0:8672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00002000:00080000:1.0:1788664122.495270:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788664122.495300:0:8426:0:(import.c:65:import_set_state_nolock()) ffff93c42e858800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664122.495357:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1875550140391680:12345-0@lo:8: Request processed in 2609us (2880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664122.495378:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664122.496264:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140391936:0@lo:400: 00000100:00100000:1.0:1788664122.496309:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664122.496336:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140392448:0@lo:400: 00000100:00100000:1.0:1788664122.496367:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664122.496393:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664122.496400:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140392320:0@lo:400: 00000100:00100000:1.0:1788664122.496433:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664122.496646:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140392064:0@lo:400: 00000100:00100000:1.0:1788664122.496673:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664122.496686:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664122.496691:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140392192:0@lo:400: 00000100:00100000:1.0:1788664122.496711:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664122.496742:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140391936 00000100:00100000:1.0:1788664122.496748:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140391936 00000100:00100000:1.0:1788664122.496801:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140392448 00000100:00100000:1.0:1788664122.496804:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140392448 00000100:00100000:1.0:1788664122.496832:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140392320 00000100:00100000:1.0:1788664122.496834:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140392320 00000100:00100000:1.0:1788664122.496843:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140392064 00000100:00100000:1.0:1788664122.496845:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140392064 00000100:00100000:1.0:1788664122.496857:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788664122.496863:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e97a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140391936:12345-0@lo:400: 00000100:00100000:1.0:1788664122.496915:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e97a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140391936:12345-0@lo:400: Request processed in 43us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664122.496922:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788664122.496936:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788664122.496950:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140392448:12345-0@lo:400: 00000100:00100000:1.0:1788664122.496977:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140392448:12345-0@lo:400: Request processed in 29us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664122.496982:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788664122.496994:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788664122.496999:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140392320:12345-0@lo:400: 00000100:00100000:1.0:1788664122.497019:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140392320:12345-0@lo:400: Request processed in 21us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664122.497024:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788664122.497036:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788664122.497041:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140392064:12345-0@lo:400: 00000020:00000080:2.0:1788664122.497102:0:8672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664122.497107:0:8672:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788664122.497116:0:8672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00080000:2.0:1788664122.497186:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664122.497191:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000000:2.0:1788664122.498122:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1788664122.498151:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788664122.498162:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d534 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d53b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.498175:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d53b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664122.498186:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788664122.498188:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c40641a800 from 30 10000000:01000000:2.0:1788664122.498191:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788664122.498222:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0c000/0xcd11f61c1413d55e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.498231:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c402a0c000/0xcd11f61c1413d55e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.498242:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c402a0c000/0xcd11f61c1413d55e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664122.498275:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140392576:0@lo:101: 00000100:00100000:2.0:1788664122.498325:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664122.498360:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42e9fed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664122.498378:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140392576 00000100:00100000:2.0:1788664122.498382:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140392576 00000100:00100000:2.0:1788664122.498417:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788664122.498426:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140392576:12345-0@lo:101: 00010000:00010000:2.0:1788664122.498437:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788664122.498444:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140392064:12345-0@lo:400: Request processed in 1400us (1767us total) trans 0 rc 0/0 00010000:00010000:2.0:1788664122.498450:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0c400/0xcd11f61c1413d565 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d55e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.498474:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0c400/0xcd11f61c1413d565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d55e expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.498483:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0c400/0xcd11f61c1413d565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d55e expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.498491:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c400, rc 0) 00000100:00100000:2.0:1788664122.498522:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140392576:12345-0@lo:101: Request processed in 97us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664122.498528:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788664122.498571:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140392576:0@lo:101: 00000100:00100000:1.0:1788664122.498576:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788664122.498611:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140392192 00000100:00100000:1.0:1788664122.498615:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140392192 00000100:00100000:1.0:1788664122.498640:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788664122.498647:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140392192:12345-0@lo:400: 00000100:00100000:1.0:1788664122.498684:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140392192:12345-0@lo:400: Request processed in 38us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664122.498690:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788664122.498722:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42e97a680 x1875550140392320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788664122.498724:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c402a0c000/0xcd11f61c1413d55e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d565 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.498745:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c402a0c000/0xcd11f61c1413d55e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d565 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664122.498747:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140392320:0@lo:400: 00010000:00080000:1.0:1788664122.498762:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42e978700 x1875550140391936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664122.498810:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140391936:0@lo:400: 00010000:00080000:1.0:1788664122.498825:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42e978000 x1875550140392448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664122.498833:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140392448:0@lo:400: 00000100:00100000:1.0:1788664122.498872:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140392192:0@lo:400: 00010000:00080000:1.0:1788664122.498884:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42e979880 x1875550140392064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664122.498893:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140392064:0@lo:400: 00010000:00080000:1.0:1788664122.498938:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c301eab480 x1875550140391680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788664132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664122.498946:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664122.498953:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788664122.498960:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788664122.498965:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788664122.498968:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c43675a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788664122.498981:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788664122.498987:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140391680:0@lo:8: 00000100:00100000:2.0:1788664122.499452:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140392704:0@lo:501: 00000100:00100000:2.0:1788664122.499486:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664122.499516:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42e9fed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664122.499531:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140392704 00000100:00100000:2.0:1788664122.499535:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140392704 00000100:00100000:1.0:1788664122.500836:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788664122.500852:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140392704:12345-0@lo:501: 00000100:00100000:1.0:1788664122.501243:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140392704:12345-0@lo:501: Request processed in 396us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664122.501254:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788664122.501330:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140392704:0@lo:501: 00000100:00100000:1.0:1788664122.501386:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e979880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140392832:0@lo:503: 00000100:00100000:1.0:1788664122.501433:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664122.501732:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4126d1180 going to sleep for 11 seconds 00000100:00100000:1.0:1788664122.501749:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140392832 00000100:00100000:1.0:1788664122.501756:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140392832 00000100:00100000:1.0:1788664122.501859:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788664122.501867:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140392832:12345-0@lo:503: 00000100:00100000:1.0:1788664122.502039:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140392832:12345-0@lo:503: Request processed in 173us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664122.502047:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788664122.502170:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e979880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140392832:0@lo:503: 00000004:00080000:2.0:1788664122.504210:0:8674:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788664122.504292:0:8674:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 217641519655ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788664122.504300:0:8674:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788664122.506827:0:8679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eaaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8679:1875550140392960:0@lo:700: 00000100:00100000:2.0:1788664122.510688:0:8679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664122.510736:0:8679:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42e9fe900 going to sleep for 11 seconds 00000100:00100000:1.0:1788664122.510839:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140392960 00000100:00100000:1.0:1788664122.510848:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140392960 00000100:00100000:1.0:1788664122.510900:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664122.510909:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8679:x1875550140392960:12345-0@lo:700: 00000100:00100000:1.0:1788664122.511195:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e979880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8435:1875550140393088:0@lo:700: 00000100:00100000:1.0:1788664122.511235:0:8435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664122.511260:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4126d1180 going to sleep for 11 seconds 00000100:00080000:2.0:1788664122.511715:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788664122.511796:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788664122.511878:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140393088 00000100:00100000:0.0:1788664122.511885:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140393088 00000100:00100000:0.0:1788664122.511938:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788664122.511948:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8435:x1875550140393088:12345-0@lo:700: 00000100:00100000:3.0:1788664122.513353:0:8681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8681:1875550140393216:0@lo:502: 00000100:00100000:3.0:1788664122.513428:0:8681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664122.513718:0:8681:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4087a19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664122.524875:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140393216 00000100:00100000:2.0:1788664122.524890:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140393216 00000100:00100000:2.0:1788664122.524979:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788664122.524989:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+18:8681:x1875550140393216:12345-0@lo:502: 00000100:00100000:2.0:1788664122.525157:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+18:8681:x1875550140393216:12345-0@lo:502: Request processed in 170us (11729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664122.525164:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788664122.525234:0:8681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8681:1875550140393216:0@lo:502: 00000100:00100000:2.0:1788664122.525302:0:8681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8681:1875550140393344:0@lo:502: 00000100:00100000:2.0:1788664122.525349:0:8681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664122.525372:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140393344 00000100:00100000:2.0:1788664122.525377:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140393344 00000100:00100000:2.0:1788664122.525398:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788664122.525413:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+18:8681:x1875550140393344:12345-0@lo:502: 00000100:00100000:2.0:1788664122.525474:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+18:8681:x1875550140393344:12345-0@lo:502: Request processed in 63us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664122.525481:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788664122.525522:0:8681:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42e9fe000 going to sleep for 11 seconds 00000100:00100000:2.0:1788664122.525534:0:8681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8681:1875550140393344:0@lo:502: 00000040:00080000:2.0:1788664122.525552:0:8681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788664122.525833:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788664122.525857:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788664122.525868:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0c000/0xcd11f61c1413d55e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d565 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.525877:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c402a0c000/0xcd11f61c1413d55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d565 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664122.525887:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788664122.525889:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c40641a800 from 5 10000000:01000000:0.0:1788664122.525893:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788664122.525916:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d56c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.525925:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d56c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.525942:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d56c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664122.525955:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140393472:0@lo:101: 00000100:00100000:0.0:1788664122.525986:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664122.526011:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c408731540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664122.526091:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140393472 00000100:00100000:2.0:1788664122.526096:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140393472 00000100:00100000:2.0:1788664122.526124:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788664122.526131:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140393472:12345-0@lo:101: 00010000:00010000:2.0:1788664122.526140:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664122.526152:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d573 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d56c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.526173:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d56c expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.526183:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d56c expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.526192:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d000, rc 0) 00000100:00100000:2.0:1788664122.526219:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+19:6508:x1875550140393472:12345-0@lo:101: Request processed in 89us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664122.526225:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788664122.526294:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140393472:0@lo:101: 00010000:00010000:0.0:1788664122.526306:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d56c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d573 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.526314:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d56c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d573 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664122.526357:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140393600:0@lo:256: 00000100:00100000:0.0:1788664122.526386:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664122.526408:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c408731540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664122.526455:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140393600 00000100:00100000:2.0:1788664122.526460:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140393600 00000100:00100000:2.0:1788664122.526480:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788664122.526494:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+19:6508:x1875550140393600:12345-0@lo:256: 20000000:01000000:2.0:1788664122.526507:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788664122.526523:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788664122.526526:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788664122.526617:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+19:6508:x1875550140393600:12345-0@lo:256: Request processed in 125us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664122.526624:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788664122.526746:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140393600:0@lo:256: 10000000:01000000:0.0:1788664122.526827:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788664122.526833:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d56c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d573 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.526841:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d56c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d573 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664122.526848:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788664122.526851:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788664122.526858:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788664122.526875:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d57a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.526883:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d57a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.526889:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d57a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664122.526900:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140393728:0@lo:101: 00000100:00100000:0.0:1788664122.526924:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664122.526940:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c435104540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664122.527122:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140393728 00000100:00100000:2.0:1788664122.527127:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140393728 00000100:00100000:2.0:1788664122.527149:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788664122.527155:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+19:6508:x1875550140393728:12345-0@lo:101: 00010000:00010000:2.0:1788664122.527162:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664122.527171:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d581 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d57a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.527185:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d57a expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.527193:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d57a expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664122.527199:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c800, rc 0) 00000100:00100000:2.0:1788664122.529197:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140393728:12345-0@lo:101: Request processed in 2033us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664122.529210:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788664122.536129:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140393728:0@lo:101: 00010000:00010000:0.0:1788664122.536159:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d57a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d581 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.536172:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d57a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d581 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 40000000:02000000:1.0:1788664122.537031:0:6518:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1788664122.537705:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140393856:0@lo:501: 00000100:00100000:0.0:1788664122.537766:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664122.537839:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c435104540 going to sleep for 11 seconds 00000100:00100000:3.0:1788664122.539749:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140393856 00000100:00100000:3.0:1788664122.539765:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140393856 00000100:00100000:3.0:1788664122.539849:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788664122.539861:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140393856:12345-0@lo:501: 00000100:00100000:3.0:1788664122.540116:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140393856:12345-0@lo:501: Request processed in 258us (2349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664122.540124:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788664122.540724:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140393856:0@lo:501: 00000100:00100000:0.0:1788664122.540806:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140393984:0@lo:503: 00000100:00100000:0.0:1788664122.540865:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664122.540902:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c435104540 going to sleep for 11 seconds 00000100:00100000:3.0:1788664122.540962:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140393984 00000100:00100000:3.0:1788664122.540968:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140393984 00000100:00100000:3.0:1788664122.541005:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788664122.541013:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140393984:12345-0@lo:503: 00000100:00100000:3.0:1788664122.541109:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140393984:12345-0@lo:503: Request processed in 96us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664122.541116:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788664122.541206:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140393984:0@lo:503: 00000100:00100000:1.0:1788664122.551223:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8435:x1875550140393088:12345-0@lo:700: Request processed in 39269us (39979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664122.551237:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788664122.551342:0:8435:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42e979880 x1875550140393088/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788664138 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664122.551357:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e979880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8435:1875550140393088:0@lo:700: 40000000:02000000:2.0:1788664122.551378:0:8435:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1788664122.558176:0:8684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8684:1875550140394112:0@lo:502: 00000100:00100000:3.0:1788664122.558268:0:8684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664122.558306:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140394112 00000100:00100000:3.0:1788664122.558314:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140394112 00000100:00100000:3.0:1788664122.558353:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788664122.558362:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+20:8684:x1875550140394112:12345-0@lo:502: 00000100:00100000:3.0:1788664122.558487:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+20:8684:x1875550140394112:12345-0@lo:502: Request processed in 125us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664122.558495:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788664122.558544:0:8684:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4087a1240 going to sleep for 11 seconds 00000100:00100000:3.0:1788664122.558565:0:8684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8684:1875550140394112:0@lo:502: 00000020:01000000:3.0:1788664122.558702:0:8684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788664122.558711:0:8684:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788664122.558717:0:8684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664122.558719:0:8684:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788664122.558724:0:8684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788664122.558728:0:8684:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:3.0:1788664122.558747:0:8684:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788664122.558749:0:8684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788664122.558763:0:8684:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93c3028db380) 00000020:00000080:3.0:1788664122.558813:0:8684:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788664122.558819:0:8684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788664122.558902:0:8684:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788664122.558907:0:8684:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788664122.558913:0:8684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413d58f 00010000:00080000:3.0:1788664122.558940:0:8684:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c30291e800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788664122.559365:0:8684:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:0.0:1788664122.566765:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788664122.566999:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8679:x1875550140392960:12345-0@lo:700: Request processed in 56085us (56311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664122.567017:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788664122.572707:0:8679:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c301eaaa00 x1875550140392960/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788664138 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664122.572729:0:8679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eaaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8679:1875550140392960:0@lo:700: 00000040:01000000:2.0:1788664122.576402:0:8684:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788664122.576426:0:8684:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788664122.576713:0:8684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788664122.584013:0:8684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788664122.584718:0:8679:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788664122.584750:0:8679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8679:1875550140394368:0@lo:7: 00000100:00100000:2.0:1788664122.584853:0:8679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664122.584893:0:8679:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c41237c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664122.584921:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140394368 00000100:00100000:2.0:1788664122.584928:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140394368 00000100:00100000:2.0:1788664122.584973:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664122.584982:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8679:x1875550140394368:12345-0@lo:7: 00000100:00100000:1.0:1788664122.585147:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140394240:0@lo:13: 00000100:00100000:1.0:1788664122.585180:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664122.585224:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140394240 00000100:00100000:1.0:1788664122.585233:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140394240 00000100:00100000:1.0:1788664122.585258:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664122.585264:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875550140394240:12345-0@lo:13: 00002000:00000024:1.0:1788664122.585281:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1788664122.585316:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875550140394240:12345-0@lo:13: Request processed in 53us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664122.585323:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788664122.585359:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c301eaaa00 x1875550140394240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664122.585377:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140394240:0@lo:13: 00000040:00080000:0.0:1788664122.585557:0:8684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788664122.586224:0:8684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788664122.587003:0:8689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788664122.587009:0:8689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788664122.600026:0:8684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788664122.600055:0:8684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788664122.600109:0:8684:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788664122.600132:0:8684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd11f61c1413d596 00000100:00080000:0.0:1788664122.600143:0:8684:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788664122.600148:0:8684:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93c30291e800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788664122.600183:0:8684:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c42f5e7b80 x1875550140394496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00080000:2.0:1788664122.600345:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788664122.600351:0:8429:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788664122.600503:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8679:x1875550140394368:12345-0@lo:7: Request processed in 15520us (15648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664122.600514:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788664122.602317:0:8684:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788664122.602470:0:8684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664122.602478:0:8684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664122.602480:0:8684:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788664122.602485:0:8684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788664122.602489:0:8684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664122.602491:0:8684:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788664122.602494:0:8684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788664122.602496:0:8684:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788664122.602536:0:8684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8684:1875550140394624:0@lo:502: 00000100:00100000:1.0:1788664122.602729:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140394496:0@lo:8: 00000100:00100000:1.0:1788664122.602822:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664122.602874:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140394496 00000100:00100000:1.0:1788664122.602882:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140394496 00000100:00100000:1.0:1788664122.602912:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788664122.602919:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1875550140394496:12345-0@lo:8: 00010000:00080000:1.0:1788664122.602945:0:8426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:1.0:1788664122.602975:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd11f61c1413d59d 00002000:00100000:1.0:1788664122.602988:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93c42e85f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788664122.602993:0:8426:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788664122.602996:0:8426:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788664122.603078:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788664122.603114:0:8426:0:(import.c:65:import_set_state_nolock()) ffff93c302982000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664122.603166:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1875550140394496:12345-0@lo:8: Request processed in 245us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664122.603174:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788664122.603227:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42f5e7b80 x1875550140394496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788664132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664122.603372:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664122.603380:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788664122.603388:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788664122.603455:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788664122.603458:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c30291e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788664122.603469:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788664122.603475:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140394496:0@lo:8: 00000100:00100000:0.0:1788664122.604145:0:8684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664122.604172:0:8684:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c435104480 going to sleep for 11 seconds 00000100:00100000:0.0:1788664122.604190:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140394624 00000100:00100000:0.0:1788664122.604195:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140394624 00000100:00100000:0.0:1788664122.604241:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788664122.604250:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+20:8684:x1875550140394624:12345-0@lo:502: 00000100:00100000:0.0:1788664122.604372:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+20:8684:x1875550140394624:12345-0@lo:502: Request processed in 123us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664122.604380:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788664122.604550:0:8684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:8684:1875550140394624:0@lo:502: 00000020:01000000:0.0:1788664122.604576:0:8684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664122.604649:0:8684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664122.604652:0:8684:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788664122.604657:0:8684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788664122.604805:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788664122.604830:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788664122.604839:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d57a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d581 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.604850:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d57a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d581 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664122.604859:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788664122.604861:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff93c422744d40 from 1 10000000:01000000:0.0:1788664122.604864:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788664122.604887:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d5a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.604895:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d5a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.604903:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d5a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664122.604918:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140394752:0@lo:101: 00000100:00100000:0.0:1788664122.604956:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664122.604970:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c435104480 going to sleep for 11 seconds 00000100:00100000:0.0:1788664122.604983:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140394752 00000100:00100000:0.0:1788664122.604987:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140394752 00000100:00100000:0.0:1788664122.605009:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788664122.605015:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140394752:12345-0@lo:101: 00010000:00010000:0.0:1788664122.605025:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00080000:3.0:1788664122.605042:0:8679:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c301ea8a80 x1875550140394368/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788664138 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788664122.605049:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40153a600/0xcd11f61c1413d5ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d5a4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664122.605053:0:8679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8679:1875550140394368:0@lo:7: 00000004:00080000:3.0:1788664122.605062:0:8679:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00010000:00010000:0.0:1788664122.605069:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40153a600/0xcd11f61c1413d5ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d5a4 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.605079:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40153a600/0xcd11f61c1413d5ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d5a4 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.605086:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40153a600, rc 0) 00000100:00100000:3.0:1788664122.605093:0:8679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8679:1875550140394880:0@lo:5: 00000100:00100000:0.0:1788664122.605114:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140394752:12345-0@lo:101: Request processed in 98us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664122.605117:0:8679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664122.605120:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788664122.605134:0:8679:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4087a1240 going to sleep for 11 seconds 00000100:00100000:0.0:1788664122.605148:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140394752:0@lo:101: 00010000:00010000:0.0:1788664122.605158:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d5a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d5ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.605167:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d5a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d5ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664122.605213:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140395008:0@lo:501: 00000100:00100000:0.0:1788664122.606364:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664122.606445:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140395008 00000100:00100000:3.0:1788664122.606452:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140395008 00000100:00100000:0.0:1788664122.606465:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c435104480 going to sleep for 11 seconds 00000004:00080000:0.0:1788664122.606482:0:8689:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788664122.606490:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788664122.606497:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140395008:12345-0@lo:501: 00000004:00080000:0.0:1788664122.606546:0:8689:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 217743773995ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788664122.606552:0:8689:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788664122.606572:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140395008:12345-0@lo:501: Request processed in 75us (211us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788664122.606579:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788664122.606784:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140394880 00000100:00100000:2.0:1788664122.606797:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140394880 00000100:00100000:2.0:1788664122.606830:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664122.606838:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8679:x1875550140394880:12345-0@lo:5: 00002000:00080000:2.0:1788664122.606858:0:8429:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788664122.606905:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8679:x1875550140394880:12345-0@lo:5: Request processed in 69us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664122.606922:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788664122.606957:0:8679:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42d9a9500 x1875550140394880/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788664138 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664122.606970:0:8679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8679:1875550140394880:0@lo:5: 00000004:00080000:3.0:1788664122.606982:0:8679:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788664122.607016:0:8679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8679:1875550140395136:0@lo:5: 00000100:00100000:3.0:1788664122.607042:0:8679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664122.607064:0:8679:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4087a1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664122.607132:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140395136 00000100:00100000:2.0:1788664122.607136:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140395136 00000100:00100000:2.0:1788664122.607158:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788664122.607165:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8679:x1875550140395136:12345-0@lo:5: 00002000:00080000:2.0:1788664122.607188:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788664122.611900:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140395008:0@lo:501: 10000000:01000000:0.0:1788664122.611953:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788664122.611965:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d5a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d5ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664122.611976:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d5ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788664122.613677:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788664122.618128:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8679:x1875550140395136:12345-0@lo:5: Request processed in 10957us (11078us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788664122.618142:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788664122.620527:0:8679:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42d9a9500 x1875550140395136/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788664138 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664122.620548:0:8679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8679:1875550140395136:0@lo:5: 00000004:00080000:2.0:1788664122.620565:0:8679:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1788664122.623084:0:8679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eaa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8679:1875550140395264:0@lo:900: 00000100:00100000:2.0:1788664122.623150:0:8679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664122.623189:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140395264 00000100:00100000:2.0:1788664122.623195:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140395264 00000100:00100000:2.0:1788664122.623389:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664122.623468:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8679:x1875550140395264:12345-0@lo:900: 00000100:00100000:2.0:1788664122.623521:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8679:x1875550140395264:12345-0@lo:900: Request processed in 55us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664122.623528:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664122.624117:0:8679:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403ce8cc0 going to sleep for 11 seconds 00010000:00080000:2.0:1788664122.624143:0:8679:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c301eaa300 x1875550140395264/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788664138 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664122.624156:0:8679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eaa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8679:1875550140395264:0@lo:900: 00000100:00100000:1.0:1788664122.624555:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664122.624567:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140395392:0@lo:13: 00000100:00100000:1.0:1788664122.624623:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664122.624652:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140395392 00000100:00100000:1.0:1788664122.624656:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140395392 00000100:00100000:1.0:1788664122.624692:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788664122.624699:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875550140395392:12345-0@lo:13: 00002000:00000024:1.0:1788664122.624714:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:1.0:1788664122.624750:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875550140395392:12345-0@lo:13: Request processed in 51us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664122.624757:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788664122.624803:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788664122.624826:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42e97a680 x1875550140395392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664122.624840:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140395392:0@lo:13: 00000004:00080000:1.0:1788664122.624853:0:8690:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788664122.624869:0:8690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8690:1875550140395520:0@lo:7: 00000100:00100000:1.0:1788664122.624903:0:8690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664122.624924:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140395520 00000100:00100000:1.0:1788664122.624927:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140395520 00000100:00100000:1.0:1788664122.624953:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788664122.624959:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8690:x1875550140395520:12345-0@lo:7: 00000100:00100000:2.0:1788664122.628160:0:8690:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4126d16c0 going to sleep for 11 seconds 00002000:00080000:1.0:1788664122.641330:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788664122.641339:0:8426:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788664122.642096:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8690:x1875550140395520:12345-0@lo:7: Request processed in 17132us (17187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664122.642108:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788664122.643835:0:8690:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42e97a680 x1875550140395520/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788664138 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664122.643855:0:8690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8690:1875550140395520:0@lo:7: 00000004:00080000:2.0:1788664122.643868:0:8690:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788664122.643905:0:8690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eaa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8690:1875550140395648:0@lo:5: 00000100:00100000:2.0:1788664122.643958:0:8690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664122.643996:0:8690:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403ce8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664122.644907:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140395648 00000100:00100000:1.0:1788664122.644916:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140395648 00000100:00100000:1.0:1788664122.644965:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788664122.644973:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8690:x1875550140395648:12345-0@lo:5: 00002000:00080000:1.0:1788664122.645002:0:8428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788664122.645006:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1788664122.654657:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1788664122.654677:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788664122.654682:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788664122.654940:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8690:x1875550140395648:12345-0@lo:5: Request processed in 9963us (10977us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788664122.654952:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788664122.655096:0:8690:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c301eaa300 x1875550140395648/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788664138 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664122.655109:0:8690:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788664122.655115:0:8690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eaa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8690:1875550140395648:0@lo:5: 00000004:00080000:2.0:1788664122.655128:0:8690:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788664122.655172:0:8690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eaa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8690:1875550140395776:0@lo:700: 00000100:00100000:2.0:1788664122.655206:0:8690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664122.655250:0:8690:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403ce8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664122.655363:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140395776 00000100:00100000:1.0:1788664122.655369:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140395776 00000100:00100000:1.0:1788664122.655517:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788664122.655527:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8690:x1875550140395776:12345-0@lo:700: 00000100:00100000:3.0:1788664122.677244:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8690:x1875550140395776:12345-0@lo:700: Request processed in 21708us (22027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664122.677259:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788664122.677345:0:8690:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c301eaa300 x1875550140395776/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788664138 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664122.677359:0:8690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eaa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8690:1875550140395776:0@lo:700: 00000004:02000040:2.0:1788664122.683324:0:8690:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1788664122.687893:0:8690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eaa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8690:1875550140395904:0@lo:5: 00000100:00100000:2.0:1788664122.687960:0:8690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664122.688070:0:8690:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403ce8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664122.688246:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140395904 00000100:00100000:3.0:1788664122.688255:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140395904 00000100:00100000:3.0:1788664122.688309:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788664122.688320:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8690:x1875550140395904:12345-0@lo:5: 00002000:00080000:3.0:1788664122.698134:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788664122.698155:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1788664122.704760:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8690:x1875550140395904:12345-0@lo:5: Request processed in 16435us (16792us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788664122.704818:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788664122.704871:0:8690:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c301eaa300 x1875550140395904/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788664138 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664122.704887:0:8690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eaa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8690:1875550140395904:0@lo:5: 00000004:00080000:2.0:1788664122.704904:0:8690:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1788664122.814909:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664123.845141:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788664124.464603:0:8803:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788664124.869670:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788664125.477479:0:8855:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788664125.477710:0:8855:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788664125.886064:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664126.017875:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140396032:0@lo:41: 00000100:00100000:0.0:1788664126.017958:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664126.018112:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140396032 00000100:00100000:0.0:1788664126.018120:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140396032 00000100:00100000:0.0:1788664126.018164:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788664126.018173:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140396032:12345-0@lo:41: 00000004:00000024:0.0:1788664126.018207:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788664126.018253:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140396032:12345-0@lo:41: Request processed in 80us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664126.019751:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788664126.019856:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140396032:0@lo:41: 00000001:00080000:2.0:1788664126.312056:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1788664126.910447:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664127.552894:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140396160:0@lo:41: 00000100:00100000:0.0:1788664127.552962:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664127.553032:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140396160 00000100:00100000:0.0:1788664127.553039:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140396160 00000100:00100000:0.0:1788664127.553075:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788664127.553082:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140396160:12345-0@lo:41: 00000004:00000024:0.0:1788664127.553113:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788664127.553150:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140396160:12345-0@lo:41: Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664127.553156:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788664127.553194:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140396160:0@lo:41: 00010000:00010000:0.0:1788664127.933882:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664128.065298:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140396288:0@lo:400: 00000100:00100000:2.0:1788664128.065386:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664128.065431:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140396800:0@lo:400: 00000100:00100000:2.0:1788664128.065459:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664128.065479:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140397312:0@lo:400: 00000100:00100000:2.0:1788664128.065500:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664128.065523:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788664128.065528:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140396416:0@lo:400: 00000100:00100000:2.0:1788664128.065551:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664128.065569:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140396928:0@lo:400: 00000100:00100000:2.0:1788664128.065603:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664128.065631:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140396544:0@lo:400: 00000100:00100000:2.0:1788664128.065665:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664128.065684:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140397056:0@lo:400: 00000100:00100000:2.0:1788664128.065724:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664128.065761:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788664128.065768:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140396672:0@lo:400: 00000100:00100000:2.0:1788664128.065813:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664128.065825:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140397184:0@lo:400: 00000100:00100000:2.0:1788664128.065845:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664128.066280:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140396800 00000100:00100000:2.0:1788664128.066288:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140396800 00000100:00100000:2.0:1788664128.066384:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140396544 00000100:00100000:2.0:1788664128.066389:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140396544 00000100:00100000:2.0:1788664128.066405:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788664128.066413:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140396800:12345-0@lo:400: 00000100:00100000:2.0:1788664128.066470:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140396800:12345-0@lo:400: Request processed in 56us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664128.066477:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788664128.066495:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788664128.066501:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140396544:12345-0@lo:400: 00000100:00100000:2.0:1788664128.066534:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140396544:12345-0@lo:400: Request processed in 33us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664128.066539:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788664128.066558:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140397312 00000100:00100000:2.0:1788664128.066561:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140397312 00000100:00100000:0.0:1788664128.066726:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140396288 00000100:00100000:0.0:1788664128.066731:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140396288 00000100:00100000:0.0:1788664128.066785:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788664128.066793:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+21:3638:x1875550140396288:12345-0@lo:400: 00000100:00100000:0.0:1788664128.066829:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+21:3638:x1875550140396288:12345-0@lo:400: Request processed in 38us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664128.066836:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788664128.067767:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140397184 00000100:00100000:2.0:1788664128.067790:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140397184 00000100:00100000:2.0:1788664128.067818:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788664128.067825:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140397312:12345-0@lo:400: 00000100:00100000:2.0:1788664128.067874:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140397312:12345-0@lo:400: Request processed in 49us (2372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664128.067880:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788664128.067906:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664128.067912:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140397184:12345-0@lo:400: 00000100:00100000:2.0:1788664128.067941:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140397184:12345-0@lo:400: Request processed in 30us (2096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664128.067946:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664128.067970:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140396416 00000100:00100000:2.0:1788664128.067974:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140396416 00000100:00100000:2.0:1788664128.067992:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140396928 00000100:00100000:2.0:1788664128.067995:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140396928 00000100:00100000:2.0:1788664128.068250:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140397056 00000100:00100000:2.0:1788664128.068254:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140397056 00000100:00100000:2.0:1788664128.068266:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140396672 00000100:00100000:2.0:1788664128.068269:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140396672 00000100:00100000:2.0:1788664128.068280:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788664128.068286:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140396416:12345-0@lo:400: 00000100:00100000:2.0:1788664128.068332:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140396416:12345-0@lo:400: Request processed in 46us (2780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664128.068338:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788664128.068350:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788664128.068356:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140396928:12345-0@lo:400: 00000100:00100000:2.0:1788664128.068382:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140396928:12345-0@lo:400: Request processed in 26us (2778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664128.068387:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788664128.068398:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788664128.068403:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140397056:12345-0@lo:400: 00000100:00100000:2.0:1788664128.068429:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140397056:12345-0@lo:400: Request processed in 26us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664128.068435:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788664128.068457:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788664128.068463:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140396672:12345-0@lo:400: 00000100:00100000:2.0:1788664128.068494:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140396672:12345-0@lo:400: Request processed in 32us (2680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664128.068500:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788664128.068554:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c301eab480 x1875550140396416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664128.068569:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140396416:0@lo:400: 00000100:00080000:0.0:1788664128.068860:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788664128.068866:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664128.068868:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788664128.069739:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42e88bb80 x1875550140396928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664128.069766:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140396928:0@lo:400: 00000100:00100000:2.0:1788664128.069945:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140396288:0@lo:400: 00000100:00100000:2.0:1788664128.069958:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140396800:0@lo:400: 00010000:00080000:2.0:1788664128.069972:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42e888700 x1875550140397312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664128.069979:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788664128.069996:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140397312:0@lo:400: 00000100:00100000:2.0:1788664128.070094:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664128.070106:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140397440:0@lo:13: 00000100:00100000:2.0:1788664128.070236:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788664128.070345:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c301ea9f80 x1875550140396672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664128.070356:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140396672:0@lo:400: 00010000:00080000:2.0:1788664128.070384:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42e88a680 x1875550140397184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664128.070390:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788664128.070399:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140397184:0@lo:400: 00000100:00100000:2.0:1788664128.070411:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140396544:0@lo:400: 00010000:00080000:2.0:1788664128.070421:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42e889180 x1875550140397056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664128.070428:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140397056:0@lo:400: 00000100:00100000:0.0:1788664128.071087:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664128.071102:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140397568:0@lo:13: 00000100:00100000:0.0:1788664128.071149:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664128.081696:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140397440 00000100:00100000:1.0:1788664128.081712:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140397440 00000100:00100000:1.0:1788664128.081805:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140397568 00000100:00100000:1.0:1788664128.081808:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140397568 00000100:00100000:1.0:1788664128.081828:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788664128.081838:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140397440:12345-0@lo:13: 00002000:00000024:1.0:1788664128.081886:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664128.081969:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140397440:12345-0@lo:13: Request processed in 131us (11730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664128.081976:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788664128.081992:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788664128.081998:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140397568:12345-0@lo:13: 00002000:00000024:1.0:1788664128.082008:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664128.082032:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140397568:12345-0@lo:13: Request processed in 35us (10883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664128.082037:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788664128.082149:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42d9a9500 x1875550140397568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788664128.082169:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42f5e4000 x1875550140397440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664128.082173:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140397568:0@lo:13: 00000100:00100000:2.0:1788664128.082190:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140397440:0@lo:13: 00000020:00000004:1.0:1788664128.408903:0:8956:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788664128.409154:0:8956:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788664128.963906:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788664129.287080:0:9004:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788664129.287091:0:9004:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1788664129.993219:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664131.006344:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664131.136070:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664131.136098:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140397696:0@lo:41: 00000100:00100000:1.0:1788664131.136168:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664131.136299:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140397696 00000100:00100000:2.0:1788664131.136307:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140397696 00000100:00100000:2.0:1788664131.136354:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788664131.136363:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140397696:12345-0@lo:41: 00000004:00000024:2.0:1788664131.136396:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788664131.136451:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140397696:12345-0@lo:41: Request processed in 89us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664131.136460:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788664131.136544:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140397696:0@lo:41: 00010000:00010000:3.0:1788664132.029945:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664132.670105:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140397824:0@lo:41: 00000100:00100000:2.0:1788664132.670192:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664132.670410:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140397824 00000100:00100000:0.0:1788664132.670420:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140397824 00000100:00100000:0.0:1788664132.670482:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788664132.670493:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140397824:12345-0@lo:41: 00000004:00000024:0.0:1788664132.670531:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788664132.670849:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140397824:12345-0@lo:41: Request processed in 356us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664132.670857:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788664132.670947:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140397824:0@lo:41: 00010000:00010000:2.0:1788664133.055696:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664133.182002:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140398336:0@lo:400: 00000100:00100000:3.0:1788664133.182104:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140397952:0@lo:400: 00000100:00100000:3.0:1788664133.182177:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664133.182222:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140398464:0@lo:400: 00000100:00100000:3.0:1788664133.182258:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664133.182274:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140398976:0@lo:400: 00000100:00100000:3.0:1788664133.182312:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664133.182569:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140397952 00000100:00100000:0.0:1788664133.182577:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140397952 00000100:00100000:0.0:1788664133.182631:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788664133.182641:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+21:3639:x1875550140397952:12345-0@lo:400: 00000100:00100000:0.0:1788664133.182697:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+21:3639:x1875550140397952:12345-0@lo:400: Request processed in 57us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664133.182704:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788664133.182748:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140398464 00000100:00100000:0.0:1788664133.182752:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140398464 00000100:00100000:0.0:1788664133.182807:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788664133.182814:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140398464:12345-0@lo:400: 00000100:00100000:0.0:1788664133.182848:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140398464:12345-0@lo:400: Request processed in 35us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664133.182855:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788664133.182905:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140397952:0@lo:400: 00000100:00100000:0.0:1788664133.182918:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140398464:0@lo:400: 00000100:00100000:2.0:1788664133.183103:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664133.183124:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140398848:0@lo:400: 00000100:00100000:2.0:1788664133.183146:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664133.183177:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140398080:0@lo:400: 00000100:00100000:2.0:1788664133.183200:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664133.183218:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140398592:0@lo:400: 00000100:00100000:2.0:1788664133.183239:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664133.183428:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140399104:0@lo:13: 00000100:00100000:2.0:1788664133.183453:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664133.183474:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788664133.183481:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140398208:0@lo:400: 00000100:00100000:2.0:1788664133.183503:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664133.183518:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140398720:0@lo:400: 00000100:00100000:2.0:1788664133.183538:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664133.183548:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140399232:0@lo:13: 00000100:00100000:2.0:1788664133.183567:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664133.183596:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140398976 00000100:00100000:2.0:1788664133.183600:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140398976 00000100:00100000:2.0:1788664133.183635:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140398848 00000100:00100000:2.0:1788664133.183638:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140398848 00000100:00100000:2.0:1788664133.183651:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664133.183657:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140398976:12345-0@lo:400: 00000100:00100000:2.0:1788664133.183695:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140398976:12345-0@lo:400: Request processed in 38us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664133.183726:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664133.183740:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664133.183746:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140398848:12345-0@lo:400: 00000100:00100000:2.0:1788664133.183804:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140398848:12345-0@lo:400: Request processed in 58us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664133.183810:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664133.183832:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140398336 00000100:00100000:2.0:1788664133.183835:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140398336 00000100:00100000:2.0:1788664133.183852:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140398080 00000100:00100000:2.0:1788664133.183855:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140398080 00000100:00100000:2.0:1788664133.183863:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140398592 00000100:00100000:2.0:1788664133.183865:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140398592 00000100:00100000:2.0:1788664133.183877:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140398720 00000100:00100000:2.0:1788664133.183879:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140398720 00000100:00100000:2.0:1788664133.183893:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788664133.183899:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140398336:12345-0@lo:400: 00000100:00100000:2.0:1788664133.183928:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140398336:12345-0@lo:400: Request processed in 29us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664133.183934:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788664133.183946:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788664133.183951:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140398080:12345-0@lo:400: 00000100:00100000:0.0:1788664133.184123:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788664133.184131:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788664133.184157:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140398208 00000100:00100000:0.0:1788664133.184160:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140398208 00000100:00100000:0.0:1788664133.184184:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788664133.184190:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140398208:12345-0@lo:400: 00000100:00100000:0.0:1788664133.184228:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140398208:12345-0@lo:400: Request processed in 39us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664133.184239:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788664133.184265:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788664133.184269:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664133.184271:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664133.184445:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140398208:0@lo:400: 00010000:00080000:0.0:1788664133.184480:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c43526e300 x1875550140398976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664133.184491:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140398976:0@lo:400: 00000100:00100000:0.0:1788664133.184523:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788664133.184530:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140398592:12345-0@lo:400: 00000100:00100000:0.0:1788664133.184566:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140398592:12345-0@lo:400: Request processed in 38us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664133.184572:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788664133.184583:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788664133.184589:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788664133.184594:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140398720:12345-0@lo:400: 00000100:00100000:0.0:1788664133.184621:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140398720:12345-0@lo:400: Request processed in 27us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664133.184626:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788664133.184653:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c43526ca80 x1875550140398720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664133.184677:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140398720:0@lo:400: 00010000:00080000:0.0:1788664133.184694:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c43526f800 x1875550140398592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664133.184702:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140398592:0@lo:400: 00000100:00100000:3.0:1788664133.185188:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140399104 00000100:00100000:3.0:1788664133.185195:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140399104 00000100:00100000:3.0:1788664133.185219:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140399232 00000100:00100000:3.0:1788664133.185222:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140399232 00000100:00100000:3.0:1788664133.185234:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788664133.185251:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140399104:12345-0@lo:13: 00002000:00000024:3.0:1788664133.185272:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664133.185328:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140399104:12345-0@lo:13: Request processed in 88us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664133.185334:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788664133.185346:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664133.185352:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140399232:12345-0@lo:13: 00002000:00000024:3.0:1788664133.185360:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664133.185383:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140399232:12345-0@lo:13: Request processed in 31us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664133.185395:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788664133.185559:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42f5e4700 x1875550140399232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664133.185575:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140399232:0@lo:13: 00010000:00080000:0.0:1788664133.185592:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42f5e7480 x1875550140399104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664133.185603:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140399104:0@lo:13: 00000100:00100000:2.0:1788664133.185677:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140398080:12345-0@lo:400: Request processed in 1725us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664133.185685:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788664133.185730:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c43526dc00 x1875550140398336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664133.185741:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140398336:0@lo:400: 00010000:00080000:2.0:1788664133.185759:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c43526ce00 x1875550140398848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664133.185767:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140398848:0@lo:400: 00010000:00080000:0.0:1788664133.185858:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c43526f480 x1875550140398080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664133.185866:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140398080:0@lo:400: 00010000:00010000:1.0:1788664134.077872:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664135.102006:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664136.126936:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664136.256670:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140399360:0@lo:41: 00000100:00100000:0.0:1788664136.256751:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664136.256839:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140399360 00000100:00100000:0.0:1788664136.256846:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140399360 00000100:00100000:0.0:1788664136.256886:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788664136.256894:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140399360:12345-0@lo:41: 00000004:00000024:0.0:1788664136.256926:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788664136.257045:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140399360:12345-0@lo:41: Request processed in 151us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664136.257053:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788664136.257107:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140399360:0@lo:41: 00010000:00010000:1.0:1788664137.149874:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664137.791499:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664137.791521:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140399488:0@lo:41: 00000100:00100000:3.0:1788664137.791584:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664137.793439:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140399488 00000100:00100000:0.0:1788664137.793452:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140399488 00000100:00100000:0.0:1788664137.793508:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788664137.793519:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140399488:12345-0@lo:41: 00000004:00000024:0.0:1788664137.793554:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788664137.793626:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140399488:12345-0@lo:41: Request processed in 110us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664137.793633:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788664137.793703:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140399488:0@lo:41: 00010000:00010000:3.0:1788664138.174340:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664138.301926:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140399616:0@lo:13: 00000100:00100000:2.0:1788664138.302319:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664138.302511:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140399744:0@lo:13: 00000100:00100000:2.0:1788664138.302539:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664138.302601:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140399616 00000100:00100000:3.0:1788664138.302608:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140399616 00000100:00100000:3.0:1788664138.302650:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140399744 00000100:00100000:3.0:1788664138.302652:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140399744 00000100:00100000:3.0:1788664138.302667:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664138.302674:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140399616:12345-0@lo:13: 00002000:00000024:3.0:1788664138.302710:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664138.302747:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140399616:12345-0@lo:13: Request processed in 74us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664138.302754:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664138.302767:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788664138.302797:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140399744:12345-0@lo:13: 00002000:00000024:3.0:1788664138.302805:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664138.302826:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140399744:12345-0@lo:13: Request processed in 30us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664138.302831:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788664138.302927:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788664138.302965:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c4367f5500 x1875550140399744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664138.302983:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140399744:0@lo:13: 00010000:00080000:2.0:1788664138.303292:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42f5e5180 x1875550140399616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664138.303306:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140399616:0@lo:13: 00000100:00100000:2.0:1788664138.303456:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140400000:0@lo:400: 00000100:00100000:2.0:1788664138.303491:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664138.303518:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140400512:0@lo:400: 00000100:00100000:2.0:1788664138.303539:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664138.303555:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788664138.303561:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140399872:0@lo:400: 00000100:00100000:2.0:1788664138.303586:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664138.303607:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140400384:0@lo:400: 00000100:00100000:2.0:1788664138.303630:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664138.303672:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140400384 00000100:00100000:2.0:1788664138.303677:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140400384 00000100:00100000:2.0:1788664138.303722:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788664138.303730:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140400384:12345-0@lo:400: 00000100:00100000:2.0:1788664138.303802:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140400384:12345-0@lo:400: Request processed in 73us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664138.303809:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788664138.303830:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140400256:0@lo:400: 00000100:00100000:2.0:1788664138.303855:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664138.303875:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788664138.303880:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140400128:0@lo:400: 00000100:00100000:2.0:1788664138.303903:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664138.303920:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140400640:0@lo:400: 00000100:00100000:0.0:1788664138.304177:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140400000 00000100:00100000:0.0:1788664138.304183:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140400000 00000100:00100000:0.0:1788664138.304212:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140400512 00000100:00100000:0.0:1788664138.304215:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140400512 00000100:00100000:0.0:1788664138.304235:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140400256 00000100:00100000:0.0:1788664138.304237:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140400256 00000100:00100000:0.0:1788664138.304249:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788664138.304255:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140400000:12345-0@lo:400: 00000100:00100000:0.0:1788664138.304293:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140400000:12345-0@lo:400: Request processed in 37us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664138.304299:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788664138.304312:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788664138.304318:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140400512:12345-0@lo:400: 00000100:00100000:0.0:1788664138.304343:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140400512:12345-0@lo:400: Request processed in 26us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664138.304349:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788664138.304359:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788664138.304365:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140400256:12345-0@lo:400: 00000100:00100000:0.0:1788664138.304405:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140400256:12345-0@lo:400: Request processed in 41us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664138.304412:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788664138.304435:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140399872 00000100:00100000:0.0:1788664138.304438:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140399872 00000100:00100000:0.0:1788664138.304460:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788664138.304467:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:3639:x1875550140399872:12345-0@lo:400: 00000100:00100000:0.0:1788664138.304497:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:3639:x1875550140399872:12345-0@lo:400: Request processed in 30us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664138.304503:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788664138.304565:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788664138.304603:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42f5e6a00 x1875550140400256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664138.304616:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140400256:0@lo:400: 00000100:00100000:2.0:1788664138.304639:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140400640 00000100:00100000:2.0:1788664138.304643:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140400640 00000100:00100000:2.0:1788664138.304669:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788664138.304676:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140400640:12345-0@lo:400: 00000100:00100000:2.0:1788664138.304722:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140400640:12345-0@lo:400: Request processed in 46us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664138.304729:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788664138.304747:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140400128 00000100:00100000:2.0:1788664138.304750:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140400128 00000100:00100000:2.0:1788664138.304793:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788664138.304807:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140400128:12345-0@lo:400: 00000100:00100000:2.0:1788664138.304841:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140400128:12345-0@lo:400: Request processed in 35us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664138.304847:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788664138.304869:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788664138.304873:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664138.304891:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140399872:0@lo:400: 00000100:00100000:2.0:1788664138.304902:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140400384:0@lo:400: 00010000:00080000:2.0:1788664138.304911:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42f5e7480 x1875550140400000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664138.304919:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140400000:0@lo:400: 00010000:00080000:2.0:1788664138.304928:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c43526f480 x1875550140400512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664138.305102:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140400128:0@lo:400: 00010000:00080000:3.0:1788664138.305116:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c43526ce00 x1875550140400640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664138.305134:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140400640:0@lo:400: 00000100:00100000:2.0:1788664138.306207:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140400512:0@lo:400: 00010000:00010000:2.0:1788664139.202371:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788664139.674792:0:9505:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:2.0:1788664139.674796:0:9505:0:(obd_mount.c:924:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788664139.674797:0:9505:0:(obd_mount.c:927:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788664139.674915:0:9505:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c302578800 00000020:01000004:2.0:1788664139.674931:0:9505:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788664139.674944:0:9505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788664139.674966:0:9505:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93c3028819c0) 00000020:00000080:2.0:1788664139.674983:0:9505:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788664139.728752:0:9505:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788664139.729942:0:9505:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1788664139.778073:0:9505:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788664139.779009:0:9505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788664139.779024:0:9505:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788664139.779037:0:9505:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd11f61c1413d5b9 00000020:01000004:1.0:1788664139.779043:0:9505:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788664139.779066:0:9505:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788664139.779069:0:9505:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788664139.779081:0:9505:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788664139.779737:0:9505:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788664139.779744:0:9505:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788664139.798130:0:9505:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788664139.798168:0:9505:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788664139.798172:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788664139.798174:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788664139.798180:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664139.798181:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664139.798182:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664139.798183:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664139.798185:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788664139.798186:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788664139.798187:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788664139.798189:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664139.798190:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788664139.798194:0:9505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788664139.798196:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788664139.798197:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788664139.798198:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664139.798199:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664139.798200:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664139.798201:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664139.798202:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788664139.798203:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788664139.798204:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788664139.798205:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664139.798206:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788664139.798412:0:9505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788664139.798433:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140400768:0@lo:253: 00000100:00100000:2.0:1788664139.798511:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664139.798597:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4127a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788664139.799106:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140400768 00000100:00100000:3.0:1788664139.799116:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140400768 00000100:00100000:2.0:1788664139.799225:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788664139.799238:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+21:9505:x1875550140400768:12345-0@lo:253: 20000000:01000000:2.0:1788664139.799269:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788664139.799273:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788664139.799278:0:6504:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788664139.799281:0:6504:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788664139.799514:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788664139.799652:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1788664139.799666:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788664139.799695:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1788664139.799701:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788664139.799721:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1788664139.799734:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1788664139.799847:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1788664139.799862:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:2.0:1788664139.799864:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:2.0:1788664139.799876:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1788664139.799881:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788664139.799892:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1788664139.799897:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:2.0:1788664139.799907:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1788664139.799914:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788664139.799934:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1788664139.799961:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1788664139.800042:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1788664139.800055:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:2.0:1788664139.800057:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:2.0:1788664139.800071:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1788664139.800076:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788664139.800090:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1788664139.800095:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:2.0:1788664139.800107:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1788664139.800112:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788664139.800124:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1788664139.800138:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1788664139.801210:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1788664139.810130:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:0.0:1788664139.810136:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:0.0:1788664139.810187:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1788664139.810197:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788664139.810214:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1788664139.810366:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:0.0:1788664139.810388:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1788664139.810396:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788664139.810409:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1788664139.810425:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1788664139.810445:0:6504:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788664139.810448:0:6504:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788664139.810452:0:6504:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788664139.810522:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788664139.810525:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788664139.813668:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1788664139.813726:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1788664139.813746:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1788664139.813900:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1788664139.813936:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1788664139.814080:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1788664139.814093:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788664139.814096:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788664139.818715:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788664139.818806:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788664139.818822:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788664139.819444:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788664139.819471:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788664139.819488:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788664139.819498:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788664139.819500:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788664139.819887:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788664139.823683:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788664139.823715:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788664139.823727:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1788664139.823738:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788664139.823740:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788664139.825054:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1788664139.825086:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1788664139.825098:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1788664139.825416:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1788664139.825439:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1788664139.825452:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1788664139.825462:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788664139.825464:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788664139.825733:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1788664139.825751:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1788664139.825763:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788664139.827621:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788664139.827645:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788664139.827658:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:3.0:1788664139.827686:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788664139.827707:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c4351ee600/0xcd11f61c1413d5c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.827742:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c402a0d600/0xcd11f61c1413d4b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d4af expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.827750:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4351eea00/0xcd11f61c1413d4e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d4d9 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.827756:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c400030400/0xcd11f61c1413d51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d518 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.827763:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d534 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.827892:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c402a0c400/0xcd11f61c1413d565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d55e expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.827899:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d57a expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.827905:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c40153a600/0xcd11f61c1413d5ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d5a4 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.827912:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c4351ee600/0xcd11f61c1413d5c0 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.828091:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c40153a600/0xcd11f61c1413d5ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d5a4 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.828105:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c40153a600/0xcd11f61c1413d5ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d5a4 expref: 21 pid: 6506 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.828131:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875550140400896:0@lo:104: 00000100:00100000:3.0:1788664139.828192:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664139.828412:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d57a expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.828421:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d581 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d57a expref: 21 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.828430:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875550140401024:0@lo:104: 00000100:00100000:3.0:1788664139.828453:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664139.828539:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c402a0c400/0xcd11f61c1413d565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d55e expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.828547:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c402a0c400/0xcd11f61c1413d565 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d55e expref: 21 pid: 6506 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.828554:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875550140401152:0@lo:104: 00000100:00100000:3.0:1788664139.828574:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664139.828626:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140400896 00000100:00100000:1.0:1788664139.828633:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140400896 00000100:00100000:1.0:1788664139.828667:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140401024 00000100:00100000:1.0:1788664139.828669:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140401024 00000100:00100000:1.0:1788664139.828690:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788664139.828698:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+4:6504:x1875550140400896:12345-0@lo:104: 00010000:00010000:1.0:1788664139.828710:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d5ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.828825:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788664139.828832:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+4:6504:x1875550140400896:12345-0@lo:104: Request processed in 135us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664139.828839:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788664139.828858:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788664139.828865:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+3:6504:x1875550140401024:12345-0@lo:104: 00010000:00010000:1.0:1788664139.828872:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d57a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d581 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.829051:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d53b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d534 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.829061:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d53b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d534 expref: 21 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.829070:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875550140401280:0@lo:104: 00000100:00100000:3.0:1788664139.829107:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664139.829122:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c400030400/0xcd11f61c1413d51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d518 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.829139:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c400030400/0xcd11f61c1413d51f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d518 expref: 21 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.829148:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875550140401408:0@lo:104: 00000100:00100000:3.0:1788664139.829164:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664139.829177:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4351eea00/0xcd11f61c1413d4e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d4d9 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.829184:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c4351eea00/0xcd11f61c1413d4e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d4d9 expref: 21 pid: 6505 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.829192:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875550140401536:0@lo:104: 00000100:00100000:3.0:1788664139.829211:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664139.829240:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c402a0d600/0xcd11f61c1413d4b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d4af expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.829248:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c402a0d600/0xcd11f61c1413d4b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d4af expref: 21 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.829255:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875550140401664:0@lo:104: 00000100:00100000:3.0:1788664139.829272:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664139.829291:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875550140400896:0@lo:104: 00000100:00100000:3.0:1788664139.829298:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875550140401024:0@lo:104: 00010000:00010000:2.0:1788664139.829520:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788664139.829534:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d5ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.829541:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40153a800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664139.829545:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d5ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.829554:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d5ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664139.829562:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d5ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664139.829568:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664139.829600:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d5a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d5ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.829608:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664139.829634:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d5a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d5ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.829640:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d5a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d5ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.829654:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664139.829657:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d57a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d581 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.829662:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40153b800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664139.829664:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d57a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d581 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.829690:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d57a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d581 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664139.829695:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d57a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d581 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664139.829700:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664139.829714:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d57a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d581 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.829720:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664139.829734:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d57a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d581 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.829740:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d57a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d581 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.829750:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664139.829752:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664139.829754:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664139.829762:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664139.829814:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140401920:0@lo:103: 00000100:00100000:2.0:1788664139.829848:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664139.829954:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140401792:0@lo:103: 00000100:00100000:3.0:1788664139.829979:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664139.830231:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788664139.830328:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140401920 00000100:00100000:2.0:1788664139.830335:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140401920 00010000:00010000:2.0:1788664139.830364:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d581 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d57a expref: 22 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664139.830391:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140401792 00000100:00100000:2.0:1788664139.830394:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140401792 00010000:00010000:2.0:1788664139.830415:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c40153a600/0xcd11f61c1413d5ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d5a4 expref: 23 pid: 6506 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664139.830435:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788664139.830443:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+23:3639:x1875550140401920:12345-0@lo:103: 00010000:00010000:2.0:1788664139.830456:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664139.830461:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d581 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d57a expref: 23 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.830470:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d57a expref: 23 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.830484:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d581 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d57a expref: 23 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.830496:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664139.830533:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+22:3639:x1875550140401920:12345-0@lo:103: Request processed in 90us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.830540:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788664139.830556:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788664139.830563:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+21:3637:x1875550140401792:12345-0@lo:103: 00010000:00010000:2.0:1788664139.830570:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664139.830574:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c40153a600/0xcd11f61c1413d5ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d5a4 expref: 21 pid: 6506 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.830582:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c40153a600/0xcd11f61c1413d5ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d5a4 expref: 21 pid: 6506 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.830592:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40153a600/0xcd11f61c1413d5ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d5a4 expref: 21 pid: 6506 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.830609:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664139.830635:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+20:3637:x1875550140401792:12345-0@lo:103: Request processed in 74us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.830641:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788664139.830683:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140401920:0@lo:103: 00010000:00010000:3.0:1788664139.830896:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664139.830916:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140401792:0@lo:103: 00000100:00100000:1.0:1788664139.831041:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+3:6504:x1875550140401024:12345-0@lo:104: Request processed in 2175us (2585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664139.831048:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788664139.831078:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788664139.831096:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664139.831108:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140401152 00000100:00100000:1.0:1788664139.831112:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140401152 00000100:00100000:1.0:1788664139.831128:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140401280 00000100:00100000:1.0:1788664139.831131:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140401280 00000100:00100000:1.0:1788664139.831139:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140401408 00000100:00100000:1.0:1788664139.831142:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140401408 00000100:00100000:1.0:1788664139.831150:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140401536 00000100:00100000:1.0:1788664139.831152:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140401536 00000100:00100000:1.0:1788664139.831161:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140401664 00000100:00100000:1.0:1788664139.831163:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140401664 00000100:00100000:1.0:1788664139.831172:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788664139.831178:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+7:6504:x1875550140401152:12345-0@lo:104: 00010000:00010000:1.0:1788664139.831188:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c402a0c000/0xcd11f61c1413d55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d565 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831361:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788664139.831367:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+7:6504:x1875550140401152:12345-0@lo:104: Request processed in 190us (2792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664139.831374:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788664139.831388:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788664139.831394:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+6:6504:x1875550140401280:12345-0@lo:104: 00010000:00010000:1.0:1788664139.831402:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d53b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831434:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788664139.831440:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+6:6504:x1875550140401280:12345-0@lo:104: Request processed in 47us (2333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664139.831446:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788664139.831466:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788664139.831472:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+5:6504:x1875550140401408:12345-0@lo:104: 00010000:00010000:1.0:1788664139.831479:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c402a0d800/0xcd11f61c1413d518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d51f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831512:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788664139.831516:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+5:6504:x1875550140401408:12345-0@lo:104: Request processed in 46us (2352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664139.831521:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788664139.831533:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788664139.831537:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302687450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+4:6504:x1875550140401536:12345-0@lo:104: 00010000:00010000:1.0:1788664139.831545:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c400030c00/0xcd11f61c1413d4d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d4e0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831572:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788664139.831576:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302687450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+4:6504:x1875550140401536:12345-0@lo:104: Request processed in 39us (2365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664139.831582:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788664139.831610:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788664139.831616:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+3:6504:x1875550140401664:12345-0@lo:104: 00010000:00010000:1.0:1788664139.831623:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c400030a00/0xcd11f61c1413d4af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d4b6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831649:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788664139.831653:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+3:6504:x1875550140401664:12345-0@lo:104: Request processed in 39us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664139.831659:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788664139.831693:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788664139.831698:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c402a0c000/0xcd11f61c1413d55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d565 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831706:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1788664139.831710:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c402a0c000/0xcd11f61c1413d55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d565 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831718:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c402a0c000/0xcd11f61c1413d55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d565 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664139.831726:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c402a0c000/0xcd11f61c1413d55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d565 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664139.831731:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788664139.831755:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c402a0c000/0xcd11f61c1413d55e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d565 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831762:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664139.831805:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c402a0c000/0xcd11f61c1413d55e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d565 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831813:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c402a0c000/0xcd11f61c1413d55e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d565 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831826:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788664139.831829:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d53b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831835:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ef200 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1788664139.831838:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d53b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831852:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d53b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664139.831859:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d53b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664139.831864:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788664139.831878:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d53b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831884:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664139.831893:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d534 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d53b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831900:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d534 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d53b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831909:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788664139.831912:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c402a0d800/0xcd11f61c1413d518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d51f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.831918:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0d800 already unused, calling callback (ffffffffc1230c20) 00010000:00010000:2.0:1788664139.832025:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788664139.832031:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c400030c00/0xcd11f61c1413d4d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d4e0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.832038:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664139.832042:0:7453:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c400030c00/0xcd11f61c1413d4d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d4e0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.832048:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c400030c00/0xcd11f61c1413d4d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d4e0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664139.832055:0:7453:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c400030c00/0xcd11f61c1413d4d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d4e0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664139.832061:0:7453:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664139.832076:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c400030c00/0xcd11f61c1413d4d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d4e0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.832082:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664139.832088:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c400030c00/0xcd11f61c1413d4d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d4e0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.832095:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c400030c00/0xcd11f61c1413d4d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d4e0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.832112:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664139.832115:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c400030a00/0xcd11f61c1413d4af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d4b6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.832121:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030a00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664139.832124:0:7453:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c400030a00/0xcd11f61c1413d4af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d4b6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.832131:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c400030a00/0xcd11f61c1413d4af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d4b6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664139.832137:0:7453:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c400030a00/0xcd11f61c1413d4af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d4b6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664139.832143:0:7453:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664139.832157:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c400030a00/0xcd11f61c1413d4af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d4b6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.832163:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664139.832169:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c400030a00/0xcd11f61c1413d4af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d4b6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.832176:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c400030a00/0xcd11f61c1413d4af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d4b6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.832185:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664139.832187:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664139.832189:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664139.832270:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140402432:0@lo:103: 00000100:00100000:3.0:1788664139.832309:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664139.832351:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664139.832357:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140402048:0@lo:103: 00000100:00100000:3.0:1788664139.832381:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664139.832407:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140402432 00000100:00100000:3.0:1788664139.832413:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140402432 00010000:00010000:3.0:1788664139.832436:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c402a0d600/0xcd11f61c1413d4b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d4af expref: 20 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.832458:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140402048 00000100:00100000:3.0:1788664139.832460:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140402048 00010000:00010000:3.0:1788664139.832471:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c402a0c400/0xcd11f61c1413d565 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d55e expref: 21 pid: 6506 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.832488:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788664139.832494:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+21:3638:x1875550140402432:12345-0@lo:103: 00010000:00010000:3.0:1788664139.832503:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664139.832508:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c402a0d600/0xcd11f61c1413d4b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d4af expref: 21 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.832516:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c402a0d600/0xcd11f61c1413d4b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d4af expref: 21 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.832531:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664139.832558:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+21:3638:x1875550140402432:12345-0@lo:103: Request processed in 64us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664139.832565:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788664139.832578:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788664139.832592:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c412c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+20:3638:x1875550140402048:12345-0@lo:103: 00010000:00010000:3.0:1788664139.832601:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664139.832605:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c402a0c400/0xcd11f61c1413d565 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d55e expref: 20 pid: 6506 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.832615:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c402a0c400/0xcd11f61c1413d565 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d55e expref: 20 pid: 6506 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.832625:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664139.832648:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c412c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+20:3638:x1875550140402048:12345-0@lo:103: Request processed in 58us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664139.832654:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788664139.832712:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140402176:0@lo:103: 00000100:00100000:3.0:1788664139.832739:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664139.832758:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664139.832763:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140402304:0@lo:103: 00000100:00100000:3.0:1788664139.832804:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664139.832827:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140402176 00000100:00100000:3.0:1788664139.832830:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140402176 00010000:00010000:3.0:1788664139.832843:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d53b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d534 expref: 20 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.832860:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140402304 00000100:00100000:3.0:1788664139.832864:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140402304 00010000:00010000:3.0:1788664139.832875:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4351eea00/0xcd11f61c1413d4e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d4d9 expref: 21 pid: 6505 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.832887:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788664139.832892:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+21:3636:x1875550140402176:12345-0@lo:103: 00010000:00010000:3.0:1788664139.832909:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664139.832914:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d53b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d534 expref: 21 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.832936:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d53b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d534 expref: 21 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.832946:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664139.832974:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+21:3636:x1875550140402176:12345-0@lo:103: Request processed in 82us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664139.832980:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788664139.832992:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788664139.832998:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+20:3636:x1875550140402304:12345-0@lo:103: 00010000:00010000:3.0:1788664139.833005:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664139.833009:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4351eea00/0xcd11f61c1413d4e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d4d9 expref: 20 pid: 6505 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.833017:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4351eea00/0xcd11f61c1413d4e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d4d9 expref: 20 pid: 6505 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.833026:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664139.833048:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+20:3636:x1875550140402304:12345-0@lo:103: Request processed in 50us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664139.833053:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1788664139.833071:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664139.833093:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140402304:0@lo:103: 00000100:00100000:3.0:1788664139.833101:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140402176:0@lo:103: 00000100:00100000:3.0:1788664139.833123:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140402048:0@lo:103: 00000100:00100000:3.0:1788664139.833139:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140402432:0@lo:103: 00010000:00010000:3.0:1788664139.833166:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0c400/0xcd11f61c1413d565 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d55e expref: 19 pid: 6506 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.833176:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875550140401152:0@lo:104: 00010000:00010000:3.0:1788664139.833185:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d53b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d534 expref: 18 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.833191:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875550140401280:0@lo:104: 00000100:00100000:3.0:1788664139.833199:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875550140401408:0@lo:104: 00010000:00010000:3.0:1788664139.833207:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4351eea00/0xcd11f61c1413d4e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d4d9 expref: 17 pid: 6505 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.833215:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875550140401536:0@lo:104: 00010000:00010000:3.0:1788664139.833223:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0d600/0xcd11f61c1413d4b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d4af expref: 16 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.833231:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875550140401664:0@lo:104: 00010000:00010000:3.0:1788664139.833256:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c4351ee600/0xcd11f61c1413d5c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664139.833559:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c402a0d800/0xcd11f61c1413d518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d51f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.833573:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c402a0d800/0xcd11f61c1413d518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d51f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664139.833580:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c402a0d800/0xcd11f61c1413d518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d51f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664139.833593:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788664139.833613:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c402a0d800/0xcd11f61c1413d518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d51f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.833620:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664139.833637:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c402a0d800/0xcd11f61c1413d518 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d51f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.833644:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c402a0d800/0xcd11f61c1413d518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d51f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.833656:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664139.833658:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664139.833660:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664139.833683:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140402560:0@lo:103: 00000100:00100000:1.0:1788664139.833716:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664139.836394:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140402560 00000100:00100000:2.0:1788664139.836429:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140402560 00010000:00010000:3.0:1788664139.836598:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c400030400/0xcd11f61c1413d51f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d518 expref: 16 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.836682:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788664139.836692:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e979880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+16:3639:x1875550140402560:12345-0@lo:103: 00010000:00010000:3.0:1788664139.836708:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664139.836721:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c400030400/0xcd11f61c1413d51f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d518 expref: 16 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.836734:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c400030400/0xcd11f61c1413d51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d518 expref: 16 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.836751:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c400030400/0xcd11f61c1413d51f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d518 expref: 16 pid: 6504 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.837175:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c4351ee600/0xcd11f61c1413d5c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.837187:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4351ee600/0xcd11f61c1413d5c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.837204:0:8443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c4351ee600/0xcd11f61c1413d5c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.837211:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c4351ee600/0xcd11f61c1413d5c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.837217:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c4351ee600/0xcd11f61c1413d5c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.837364:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c4351ee600/0xcd11f61c1413d5c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.837370:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ee600 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664139.837375:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c4351ee600/0xcd11f61c1413d5c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.837382:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c4351ee600/0xcd11f61c1413d5c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.837531:0:6504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c4351ee600/0xcd11f61c1413d5c0 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.837539:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c4351ee600/0xcd11f61c1413d5c0 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788664139.837547:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1788664139.838003:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c4351ee600/0xcd11f61c1413d5c0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.838012:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4351ee600/0xcd11f61c1413d5c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.838030:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664139.838102:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e979880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+15:3639:x1875550140402560:12345-0@lo:103: Request processed in 1410us (4383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664139.838111:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788664139.839864:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140402560:0@lo:103: 00000100:00100000:3.0:1788664139.841035:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+14:9505:x1875550140400768:12345-0@lo:253: Request processed in 41798us (42519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664139.841049:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788664139.841472:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140400768:0@lo:253: 10000000:01000000:2.0:1788664139.841486:0:9505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788664139.841489:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788664139.841491:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788664139.841492:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664139.841493:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788664139.841495:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664139.841496:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664139.841497:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788664139.841499:0:9505:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788664139.841501:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664139.841502:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788664139.841524:0:9505:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c302578800 from lustre-OST0001 10000000:01000000:2.0:1788664139.841552:0:9505:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788664139.841555:0:9505:0:(mgc_request.c:327:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788664139.841563:0:9505:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93c422744d40 local copy 10000000:01000000:2.0:1788664139.841567:0:9505:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788664139.841602:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0c800/0xcd11f61c1413d5c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.841612:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.152@tcp lock: ffff93c402a0c800/0xcd11f61c1413d5c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.841622:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c402a0c800/0xcd11f61c1413d5c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664139.841661:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140402688:0@lo:101: 00000100:00100000:2.0:1788664139.841715:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664139.842043:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4127a1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788664139.842412:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140402688 00000100:00100000:0.0:1788664139.842428:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140402688 00000100:00100000:0.0:1788664139.842478:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788664139.842486:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+14:9505:x1875550140402688:12345-0@lo:101: 00010000:00010000:0.0:1788664139.842499:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664139.842515:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40153b600/0xcd11f61c1413d5ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d5c7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664139.842540:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40153b600/0xcd11f61c1413d5ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d5c7 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664139.842550:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40153b600/0xcd11f61c1413d5ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d5c7 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664139.842558:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40153b600, rc 0) 00000100:00100000:0.0:1788664139.842647:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:9505:x1875550140402688:12345-0@lo:101: Request processed in 161us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664139.842653:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788664139.843062:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140402688:0@lo:101: 00010000:00010000:3.0:1788664139.843077:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c402a0c800/0xcd11f61c1413d5c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcd11f61c1413d5ce expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.843087:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c402a0c800/0xcd11f61c1413d5c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd11f61c1413d5ce expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.843198:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140402816:0@lo:501: 00000100:00100000:3.0:1788664139.843366:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664139.843433:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664139.843469:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140402816 00000100:00100000:0.0:1788664139.843475:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140402816 00000100:00100000:0.0:1788664139.843548:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788664139.843557:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:9505:x1875550140402816:12345-0@lo:501: 00000100:00100000:0.0:1788664139.843628:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:9505:x1875550140402816:12345-0@lo:501: Request processed in 71us (261us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788664139.843635:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788664139.843699:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140402816:0@lo:501: 10000000:01000000:3.0:1788664139.843712:0:9505:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788664139.843730:0:9505:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788664139.843735:0:9505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0c800/0xcd11f61c1413d5c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd11f61c1413d5ce expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.843752:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0c800/0xcd11f61c1413d5c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd11f61c1413d5ce expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.843759:0:9505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c402a0c800/0xcd11f61c1413d5c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd11f61c1413d5ce expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.843803:0:9505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788664139.843825:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c302578800 10000000:01000000:3.0:1788664139.843831:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788664139.843836:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788664139.843838:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788664139.843842:0:9505:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788664139.843844:0:9505:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788664139.843862:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d5d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.843870:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d5d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.843878:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d5d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.843889:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140402944:0@lo:101: 00000100:00100000:3.0:1788664139.843914:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664139.843964:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664139.843972:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c402a0c800/0xcd11f61c1413d5c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd11f61c1413d5ce expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.843978:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1788664139.843982:0:7453:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c402a0c800/0xcd11f61c1413d5c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd11f61c1413d5ce expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.843991:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c402a0c800/0xcd11f61c1413d5c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcd11f61c1413d5ce expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664139.844009:0:7453:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c402a0c800/0xcd11f61c1413d5c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcd11f61c1413d5ce expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664139.844016:0:7453:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788664139.844035:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c402a0c800/0xcd11f61c1413d5c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd11f61c1413d5ce expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.844042:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664139.844059:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c402a0c800/0xcd11f61c1413d5c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd11f61c1413d5ce expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.844067:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c402a0c800/0xcd11f61c1413d5c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd11f61c1413d5ce expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.844078:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664139.844080:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664139.844082:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664139.844093:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140403072:0@lo:103: 00000100:00100000:1.0:1788664139.844125:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664139.844164:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140403072 00000100:00100000:1.0:1788664139.844168:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140403072 00000100:00100000:1.0:1788664139.844201:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788664139.844208:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+15:3636:x1875550140403072:12345-0@lo:103: 00010000:00010000:1.0:1788664139.844228:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664139.844248:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40153b600/0xcd11f61c1413d5ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d5c7 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.844261:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664139.844296:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+14:3636:x1875550140403072:12345-0@lo:103: Request processed in 89us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664139.844304:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788664139.844329:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140403072:0@lo:103: 00000100:00100000:3.0:1788664139.844691:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664139.844752:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140402944 00000100:00100000:2.0:1788664139.844757:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140402944 00000100:00100000:2.0:1788664139.844804:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788664139.844811:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+14:9505:x1875550140402944:12345-0@lo:101: 00010000:00010000:2.0:1788664139.844821:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664139.844833:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d5dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d5d5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.844851:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d5d5 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.844860:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d5d5 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.844866:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d400, rc 0) 00000100:00100000:2.0:1788664139.844903:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:9505:x1875550140402944:12345-0@lo:101: Request processed in 93us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.844908:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788664139.845066:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140402944:0@lo:101: 00010000:00010000:3.0:1788664139.845079:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d5d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d5dc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.845100:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d5d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d5dc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.845177:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140403200:0@lo:501: 00000100:00100000:3.0:1788664139.845205:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664139.845240:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664139.845397:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140403200 00000100:00100000:2.0:1788664139.845402:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140403200 00000100:00100000:2.0:1788664139.845423:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788664139.845429:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:9505:x1875550140403200:12345-0@lo:501: 00000100:00100000:2.0:1788664139.845527:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:9505:x1875550140403200:12345-0@lo:501: Request processed in 98us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.845544:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788664139.845619:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140403200:0@lo:501: 00000100:00100000:3.0:1788664139.845645:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140403328:0@lo:503: 00000100:00100000:3.0:1788664139.845695:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664139.845715:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664139.845767:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140403328 00000100:00100000:2.0:1788664139.845797:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140403328 00000100:00100000:2.0:1788664139.845815:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788664139.845821:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:9505:x1875550140403328:12345-0@lo:503: 00000100:00100000:2.0:1788664139.845892:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:9505:x1875550140403328:12345-0@lo:503: Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.845898:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788664139.846023:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140403328:0@lo:503: 00000040:00080000:3.0:1788664139.846414:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788664139.846493:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140403456:0@lo:502: 00000100:00100000:3.0:1788664139.846542:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664139.846563:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664139.846610:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140403456 00000100:00100000:2.0:1788664139.846615:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140403456 00000100:00100000:2.0:1788664139.846636:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788664139.846644:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:9505:x1875550140403456:12345-0@lo:502: 00000100:00100000:2.0:1788664139.846737:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:9505:x1875550140403456:12345-0@lo:502: Request processed in 93us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.846743:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788664139.846855:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140403456:0@lo:502: 00000040:00080000:3.0:1788664139.847126:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788664139.847154:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788664139.847169:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788664139.847183:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788664139.847197:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788664139.847211:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788664139.847363:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140403584:0@lo:502: 00000100:00100000:3.0:1788664139.847401:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664139.847474:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664139.847563:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140403584 00000100:00100000:0.0:1788664139.847569:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140403584 00000100:00100000:1.0:1788664139.847641:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788664139.847650:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:9505:x1875550140403584:12345-0@lo:502: 00000100:00100000:1.0:1788664139.847751:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:9505:x1875550140403584:12345-0@lo:502: Request processed in 102us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664139.847759:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788664139.847850:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140403584:0@lo:502: 00000040:00080000:3.0:1788664139.847892:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788664139.847900:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1788664139.848733:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788664139.848742:0:9516:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788664139.848749:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664139.848751:0:9516:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788664139.848759:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788664139.849018:0:9516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93c302880000) 00000020:00000080:2.0:1788664139.849042:0:9516:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788664139.849050:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788664139.849121:0:9516:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c302578800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788664139.849130:0:9516:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788664139.849137:0:9516:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd11f61c1413d5ea 00010000:00010000:3.0:1788664139.855644:0:9516:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788664139.856181:0:9516:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788664139.859810:0:9516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788664139.860443:0:9516:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788664139.869159:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788664139.870071:0:9516:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788664139.879754:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788664139.884192:0:9516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788664139.884204:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664139.884210:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664139.884213:0:9516:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788664139.884217:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664139.884221:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664139.884223:0:9516:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788664139.884226:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788664139.884228:0:9516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788664139.884265:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664139.884269:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664139.884270:0:9516:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788664139.884274:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788664139.884492:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788664139.884519:0:9505:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788664139.884545:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d5d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d5dc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.884557:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d5d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d5dc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664139.884565:0:9505:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c302578800 from 1 10000000:01000000:3.0:1788664139.884568:0:9505:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788664139.884604:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351eea00/0xcd11f61c1413d5f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.884613:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4351eea00/0xcd11f61c1413d5f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.884624:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4351eea00/0xcd11f61c1413d5f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.884646:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140403712:0@lo:101: 00000100:00100000:3.0:1788664139.885476:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664139.885527:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788664139.885605:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140403712 00000100:00100000:2.0:1788664139.885615:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140403712 00000100:00100000:2.0:1788664139.885667:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788664139.885695:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:9505:x1875550140403712:12345-0@lo:101: 00010000:00010000:2.0:1788664139.885710:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664139.885724:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d5f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d5f1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.885750:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d5f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d5f1 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.885906:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d5f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d5f1 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.885916:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c800, rc 0) 00000100:00100000:2.0:1788664139.886367:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:9505:x1875550140403712:12345-0@lo:101: Request processed in 672us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.886375:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788664139.889419:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140403712:0@lo:101: 00010000:00010000:3.0:1788664139.889447:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4351eea00/0xcd11f61c1413d5f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d5f8 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.889460:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4351eea00/0xcd11f61c1413d5f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d5f8 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.889578:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140403840:0@lo:501: 00000100:00100000:3.0:1788664139.889636:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664139.889682:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788664139.889802:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140403840 00000100:00100000:2.0:1788664139.889809:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140403840 00000100:00100000:2.0:1788664139.889851:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788664139.889860:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:9505:x1875550140403840:12345-0@lo:501: 00000100:00100000:2.0:1788664139.890129:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:9505:x1875550140403840:12345-0@lo:501: Request processed in 269us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.890138:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788664139.890348:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140403840:0@lo:501: 00000100:00100000:0.0:1788664139.890379:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140403968:0@lo:503: 00000100:00100000:0.0:1788664139.890446:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664139.890476:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411902300 going to sleep for 11 seconds 00000100:00100000:2.0:1788664139.890524:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140403968 00000100:00100000:2.0:1788664139.890530:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140403968 00000100:00100000:2.0:1788664139.890564:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788664139.890571:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:9505:x1875550140403968:12345-0@lo:503: 00000100:00100000:2.0:1788664139.890658:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:9505:x1875550140403968:12345-0@lo:503: Request processed in 87us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.890686:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788664139.891155:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140403968:0@lo:503: 00000040:00080000:0.0:1788664139.891574:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788664139.891646:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140404096:0@lo:502: 00000100:00100000:0.0:1788664139.891709:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664139.891736:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411902300 going to sleep for 11 seconds 00000100:00100000:2.0:1788664139.891907:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140404096 00000100:00100000:2.0:1788664139.891913:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140404096 00000100:00100000:2.0:1788664139.892040:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788664139.892050:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:9505:x1875550140404096:12345-0@lo:502: 00000100:00100000:2.0:1788664139.892171:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:9505:x1875550140404096:12345-0@lo:502: Request processed in 122us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.892187:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788664139.892902:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140404096:0@lo:502: 00000040:00080000:0.0:1788664139.893400:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788664139.893429:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788664139.893460:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140404224:0@lo:502: 00000100:00100000:0.0:1788664139.893553:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664139.893584:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411902300 going to sleep for 11 seconds 00000100:00100000:2.0:1788664139.893653:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140404224 00000100:00100000:2.0:1788664139.893660:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140404224 00000100:00100000:2.0:1788664139.893712:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788664139.893720:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:9505:x1875550140404224:12345-0@lo:502: 00000100:00100000:2.0:1788664139.893918:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:9505:x1875550140404224:12345-0@lo:502: Request processed in 197us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.893926:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788664139.894315:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140404224:0@lo:502: 00000040:00080000:0.0:1788664139.894368:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788664139.894378:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788664139.895454:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664139.895465:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664139.895468:0:9520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788664139.895476:0:9520:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c302578800 00000020:00000080:3.0:1788664139.895478:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788664139.895491:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664139.895495:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664139.895496:0:9520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788664139.895499:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788664139.895633:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788664139.895659:0:9505:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788664139.895734:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351eea00/0xcd11f61c1413d5f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d5f8 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664139.895745:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4351eea00/0xcd11f61c1413d5f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d5f8 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664139.895832:0:9505:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788664139.895836:0:9505:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff93c302578800 10000000:01000000:0.0:1788664139.895839:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c302578800 10000000:01000000:0.0:1788664139.895852:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788664139.895858:0:9505:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c302578800 from 1 10000000:01000000:0.0:1788664139.895861:0:9505:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788664139.895893:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153b400/0xcd11f61c1413d5ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664139.895902:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c40153b400/0xcd11f61c1413d5ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664139.895913:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c40153b400/0xcd11f61c1413d5ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664139.896081:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140404352:0@lo:101: 00000100:00100000:0.0:1788664139.896151:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664139.896195:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411902c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788664139.897896:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140404352 00000100:00100000:3.0:1788664139.897908:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140404352 00000100:00100000:3.0:1788664139.897967:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788664139.897979:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:9505:x1875550140404352:12345-0@lo:101: 00010000:00010000:3.0:1788664139.897996:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664139.898012:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4351eee00/0xcd11f61c1413d606 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d5ff expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.898052:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4351eee00/0xcd11f61c1413d606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d5ff expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.898064:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4351eee00/0xcd11f61c1413d606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d5ff expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.898074:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351eee00, rc 0) 00000100:00100000:3.0:1788664139.898135:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:9505:x1875550140404352:12345-0@lo:101: Request processed in 159us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664139.898142:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788664139.898927:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140404352:0@lo:101: 00010000:00010000:0.0:1788664139.898957:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c40153b400/0xcd11f61c1413d5ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d606 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664139.898967:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c40153b400/0xcd11f61c1413d5ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d606 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664139.899074:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140404480:0@lo:501: 00000100:00100000:0.0:1788664139.899136:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664139.899166:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411902c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788664139.899194:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140404480 00000100:00100000:0.0:1788664139.899199:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140404480 00000100:00100000:0.0:1788664139.899477:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788664139.899488:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:9505:x1875550140404480:12345-0@lo:501: 00000100:00100000:0.0:1788664139.899612:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:9505:x1875550140404480:12345-0@lo:501: Request processed in 127us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664139.899620:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788664139.900384:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140404480:0@lo:501: 00000100:00100000:2.0:1788664139.900426:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140404608:0@lo:503: 00000100:00100000:2.0:1788664139.900484:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664139.900519:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c435203600 going to sleep for 11 seconds 00000100:00100000:0.0:1788664139.900573:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140404608 00000100:00100000:0.0:1788664139.900579:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140404608 00000100:00100000:0.0:1788664139.900622:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788664139.900629:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:9505:x1875550140404608:12345-0@lo:503: 00000100:00100000:0.0:1788664139.900738:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:9505:x1875550140404608:12345-0@lo:503: Request processed in 108us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664139.900746:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788664139.900916:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140404608:0@lo:503: 00000040:00080000:2.0:1788664139.906403:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788664139.906525:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140404736:0@lo:502: 00000100:00100000:2.0:1788664139.906607:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664139.906707:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4352039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664139.908313:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140404736 00000100:00100000:0.0:1788664139.908323:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140404736 00000100:00100000:0.0:1788664139.908420:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788664139.908430:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:9505:x1875550140404736:12345-0@lo:502: 00000100:00100000:0.0:1788664139.908590:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:9505:x1875550140404736:12345-0@lo:502: Request processed in 161us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664139.908597:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788664139.908790:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140404736:0@lo:502: 00000040:00080000:1.0:1788664139.909038:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788664139.909068:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788664139.909095:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788664139.909113:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788664139.909129:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788664139.909142:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788664139.909155:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788664139.909189:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788664139.909203:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788664139.909216:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788664139.909228:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788664139.909499:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788664139.909515:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788664139.909528:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788664139.909540:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788664139.909552:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788664139.909564:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788664139.909576:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788664139.909587:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788664139.909599:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788664139.909611:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788664139.909623:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788664139.909636:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788664139.909650:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788664139.909663:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788664139.909687:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788664139.909703:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788664139.909717:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788664139.909730:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788664139.909743:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788664139.909754:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788664139.909765:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788664139.909806:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788664139.909818:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788664139.909829:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788664139.909841:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788664139.909872:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1788664139.909888:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1788664139.909901:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1788664139.909913:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1788664139.909938:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1788664139.910033:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1788664139.910047:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1788664139.910059:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1788664139.910070:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1788664139.910081:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1788664139.910313:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140404864:0@lo:502: 00000100:00100000:1.0:1788664139.910372:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664139.911488:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f764840 going to sleep for 11 seconds 00000100:00100000:2.0:1788664139.911562:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140404864 00000100:00100000:2.0:1788664139.911571:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140404864 00000100:00100000:2.0:1788664139.911618:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788664139.911638:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:9505:x1875550140404864:12345-0@lo:502: 00000100:00100000:2.0:1788664139.911915:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:9505:x1875550140404864:12345-0@lo:502: Request processed in 278us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664139.912161:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140404864:0@lo:502: 00000040:00080000:1.0:1788664139.912433:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1788664139.912446:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000100:00100000:2.0:1788664139.912687:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000020:01000004:0.0:1788664139.913482:0:9521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788664139.913496:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93c412cacd40) 00000020:00000080:0.0:1788664139.913517:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1788664139.913586:0:9521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c302578800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788664139.913590:0:9521:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c302578800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788664139.913593:0:9521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c302578800 3 00010000:00080000:0.0:1788664139.913627:0:9521:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c43675a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1788664139.925514:0:9521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1788664139.925847:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788664139.925893:0:9521:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788664139.925911:0:9521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcd11f61c1413d614 00000100:00080000:0.0:1788664139.925931:0:9521:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788664139.925937:0:9521:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93c43675a800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788664139.925980:0:9521:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c43526f800 x1875550140404992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788664139.925998:0:9521:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788664139.926436:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140405120:0@lo:400: 00000100:00100000:0.0:1788664139.926502:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664139.926541:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140405632:0@lo:400: 00000100:00100000:0.0:1788664139.926565:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664139.926587:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788664139.926593:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140405504:0@lo:400: 00000100:00100000:0.0:1788664139.926631:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664139.926650:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140406016:0@lo:400: 00000100:00100000:0.0:1788664139.926686:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664139.926724:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140405120 00000100:00100000:0.0:1788664139.926731:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140405120 00000100:00100000:0.0:1788664139.926798:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140405632 00000100:00100000:0.0:1788664139.926802:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140405632 00000100:00100000:0.0:1788664139.926828:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788664139.926837:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140405120:12345-0@lo:400: 00000100:00100000:0.0:1788664139.926891:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140405120:12345-0@lo:400: Request processed in 55us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664139.926898:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788664139.926913:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788664139.926921:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140405632:12345-0@lo:400: 00000100:00100000:0.0:1788664139.927044:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140405632:12345-0@lo:400: Request processed in 123us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664139.927057:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788664139.927081:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140405504 00000100:00100000:0.0:1788664139.928067:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140405504 00000100:00100000:0.0:1788664139.928443:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788664139.928454:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140405504:12345-0@lo:400: 00000100:00100000:0.0:1788664139.928520:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140405504:12345-0@lo:400: Request processed in 69us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664139.928527:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788664139.928550:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140406016 00000100:00100000:0.0:1788664139.928554:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140406016 00000100:00100000:0.0:1788664139.928581:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664139.928589:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140406016:12345-0@lo:400: 00000100:00100000:0.0:1788664139.928628:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140406016:12345-0@lo:400: Request processed in 41us (1941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664139.928635:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664139.928688:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140405504:0@lo:400: 00010000:00080000:0.0:1788664139.928703:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c3036f9f80 x1875550140406016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664139.928714:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140406016:0@lo:400: 00010000:00080000:0.0:1788664139.928725:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42f5e5180 x1875550140405120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664139.928733:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140405120:0@lo:400: 00010000:00080000:0.0:1788664139.928742:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42f5e7480 x1875550140405632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664139.928760:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140405632:0@lo:400: 00000100:00100000:1.0:1788664139.928919:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1875550140404992:0@lo:38: 00000100:00100000:1.0:1788664139.929042:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664139.929170:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140405376:0@lo:400: 00000100:00100000:1.0:1788664139.929209:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664139.929412:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140405888:0@lo:400: 00000100:00100000:1.0:1788664139.929454:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664139.929481:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788664139.929487:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140405248:0@lo:400: 00000100:00100000:1.0:1788664139.929512:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664139.929531:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140405760:0@lo:400: 00000100:00100000:1.0:1788664139.929553:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664139.929579:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140405888 00000100:00100000:1.0:1788664139.929584:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140405888 00000100:00100000:1.0:1788664139.929615:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788664139.929622:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140405888:12345-0@lo:400: 00000100:00100000:1.0:1788664139.929679:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140405888:12345-0@lo:400: Request processed in 48us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664139.929687:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788664139.929708:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140405248 00000100:00100000:1.0:1788664139.929712:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140405248 00000100:00100000:1.0:1788664139.929736:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788664139.929742:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140405248:12345-0@lo:400: 00000100:00100000:1.0:1788664139.929810:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140405248:12345-0@lo:400: Request processed in 67us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664139.929816:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788664139.929836:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140404992 00000100:00100000:1.0:1788664139.929839:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140404992 00000100:00100000:1.0:1788664139.929858:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140405376 00000100:00100000:1.0:1788664139.929861:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140405376 00000100:00100000:1.0:1788664139.929879:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140405760 00000100:00100000:1.0:1788664139.929881:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140405760 00000100:00100000:1.0:1788664139.929897:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788664139.929905:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140405376:12345-0@lo:400: 00000100:00100000:2.0:1788664139.930133:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788664139.930140:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1875550140404992:12345-0@lo:38: 00010000:00080000:2.0:1788664139.930164:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:2.0:1788664139.930226:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcd11f61c1413d61b 00000100:00100000:0.0:1788664139.930456:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788664139.930466:0:6512:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788664139.931018:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140405248:0@lo:400: 00010000:00080000:3.0:1788664139.931046:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c3036fa680 x1875550140405888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664139.931057:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140405888:0@lo:400: 00000004:00100000:2.0:1788664139.933426:0:6511:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788664139.933474:0:6511:0:(import.c:65:import_set_state_nolock()) ffff93c3029fb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664139.933566:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875550140404992:12345-0@lo:38: Request processed in 3423us (4522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.933577:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788664139.933605:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788664139.933616:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140405760:12345-0@lo:400: 00000100:00100000:2.0:1788664139.933663:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140405760:12345-0@lo:400: Request processed in 51us (4109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.933670:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788664139.933939:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140405376:12345-0@lo:400: Request processed in 4033us (4728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664139.933947:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788664139.933989:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c43526f800 x1875550140404992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664139.934001:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664139.934009:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788664139.934017:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788664139.934021:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788664139.934023:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c43675a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788664139.934039:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1875550140404992:0@lo:38: 00010000:00080000:3.0:1788664139.934690:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c3036fad80 x1875550140405760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664139.934703:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140405760:0@lo:400: 00010000:00080000:3.0:1788664139.934717:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42f5e4000 x1875550140405376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664139.934724:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140405376:0@lo:400: 00000020:01000004:0.0:1788664139.937607:0:9521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788664139.937625:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff93c412cab380) 00000020:00000080:0.0:1788664139.937651:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1788664139.937800:0:9521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c302578800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788664139.937805:0:9521:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c302578800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788664139.937808:0:9521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c302578800 3 00010000:00080000:0.0:1788664139.937840:0:9521:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c430698800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.152@tcp at head 00000100:00100000:1.0:1788664139.938162:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303707100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9523:1875550140406144:0@lo:901: 00000100:00100000:1.0:1788664139.938243:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664139.938276:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f764240 going to sleep for 11 seconds 00000100:00100000:3.0:1788664139.940075:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140406144 00000100:00100000:3.0:1788664139.940098:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140406144 00000100:00100000:3.0:1788664139.940165:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664139.940194:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9523:x1875550140406144:12345-0@lo:901: 00000100:00100000:3.0:1788664139.940327:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9523:x1875550140406144:12345-0@lo:901: Request processed in 146us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664139.940335:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788664139.940357:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788664139.942164:0:9523:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c303707100 x1875550140406144/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788664155 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664139.942191:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303707100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9523:1875550140406144:0@lo:901: 00010000:00010000:0.0:1788664139.945505:0:9521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1788664139.945807:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788664139.945861:0:9521:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788664139.945874:0:9521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xcd11f61c1413d629 00000100:00080000:0.0:1788664139.945884:0:9521:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788664139.945891:0:9521:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93c430698800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788664139.945937:0:9521:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c43526f480 x1875550140406272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788664139.945959:0:9521:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788664139.946401:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1875550140406272:0@lo:38: 00000100:00100000:1.0:1788664139.946469:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788664139.946661:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1788664139.946721:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1788664139.946752:0:9505:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788664139.946766:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153b400/0xcd11f61c1413d5ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d606 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.946799:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c40153b400/0xcd11f61c1413d5ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d606 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788664139.946846:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788664139.946848:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788664139.946849:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664139.946851:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664139.946852:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664139.946855:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664139.946856:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664139.946857:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788664139.946859:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788664139.946860:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664139.946861:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788664139.946865:0:9505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788664139.946871:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788664139.946873:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788664139.946874:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664139.946875:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664139.946876:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664139.946877:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664139.946878:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664139.946879:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788664139.946880:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788664139.946880:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664139.946881:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788664139.946898:0:9505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788664139.946909:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140406400:0@lo:253: 00000100:00100000:1.0:1788664139.946955:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664139.946971:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f764240 going to sleep for 11 seconds 00000100:00100000:1.0:1788664139.947047:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140406400 00000100:00100000:1.0:1788664139.947053:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140406400 00000100:00100000:1.0:1788664139.947102:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788664139.947111:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:9505:x1875550140406400:12345-0@lo:253: 20000000:01000000:1.0:1788664139.947135:0:6504:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788664139.947147:0:6504:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788664139.947642:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140406272 00000100:00100000:3.0:1788664139.947648:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140406272 00000100:00100000:3.0:1788664139.947688:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664139.947694:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1875550140406272:12345-0@lo:38: 00010000:00080000:3.0:1788664139.947717:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:3.0:1788664139.947759:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xcd11f61c1413d630 00000004:00100000:3.0:1788664139.947796:0:6511:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788664139.947828:0:6511:0:(import.c:65:import_set_state_nolock()) ffff93c302b97000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664139.947889:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875550140406272:12345-0@lo:38: Request processed in 194us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664139.947896:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788664139.948037:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c43526f480 x1875550140406272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664139.948048:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788664139.948056:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788664139.948062:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788664139.948067:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788664139.948069:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c430698800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788664139.948075:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1875550140406272:0@lo:38: 20000000:01000000:2.0:1788664139.960683:0:6504:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788664139.960732:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788664139.961342:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a681e771-e9ab-478d-af58-39fce2e20de6:9505:1875550140406400:0@lo:253: 10000000:01000000:3.0:1788664139.961357:0:9505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788664139.961360:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788664139.961362:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788664139.961363:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664139.961364:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664139.961365:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664139.961367:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664139.961368:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788664139.961370:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788664139.961371:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788664139.961373:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664139.961374:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788664139.961393:0:9505:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788664139.961968:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:9505:x1875550140406400:12345-0@lo:253: Request processed in 14117us (14271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.961983:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 20000000:01000000:1.0:1788664139.962967:0:6527:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788664139.962974:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788664139.962996:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d637 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.963013:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4029e3600/0xcd11f61c1413d52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d526 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.963021:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d56c expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.963027:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d637 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.963081:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d56c expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.963223:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d573 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d56c expref: 16 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664139.963868:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303707800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875550140406528:0@lo:104: 00000100:00100000:1.0:1788664139.963990:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664139.964107:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4029e3600/0xcd11f61c1413d52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d526 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.964118:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c4029e3600/0xcd11f61c1413d52d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d526 expref: 16 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664139.964128:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303704e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875550140406656:0@lo:104: 00000100:00100000:1.0:1788664139.964152:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664139.970059:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f764480 going to sleep for 11 seconds 00080000:10000000:3.0:1788664139.970288:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788664139.970469:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788664139.970683:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788664139.970870:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788664139.971378:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788664139.971596:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:2.0:1788664139.971852:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140406528 00000100:00100000:2.0:1788664139.971862:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140406528 00000100:00100000:2.0:1788664139.972876:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140406656 00000100:00100000:2.0:1788664139.972883:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140406656 00000100:00100000:2.0:1788664139.972914:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788664139.972936:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303704a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+4:6527:x1875550140406528:12345-0@lo:104: 00010000:00010000:2.0:1788664139.972955:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d56c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d573 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.973050:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664139.973056:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303704a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+4:6527:x1875550140406528:12345-0@lo:104: Request processed in 135us (9066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.973064:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788664139.973093:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788664139.973102:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303706300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+3:6527:x1875550140406656:12345-0@lo:104: 00010000:00010000:2.0:1788664139.973110:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d52d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664139.973143:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788664139.973148:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303706300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+3:6527:x1875550140406656:12345-0@lo:104: Request processed in 49us (8996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664139.973154:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788664139.973507:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788664139.973514:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d56c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d573 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.973523:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400031400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1788664139.973528:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d56c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d573 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.973537:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d56c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d573 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664139.973544:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d56c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d573 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664139.973559:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788664139.973598:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d56c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d573 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.973604:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664139.973622:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d56c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d573 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.973629:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d56c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d573 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.973643:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664139.973646:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d52d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.973651:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1788664139.973654:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d52d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.973661:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d52d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664139.973667:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d52d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664139.973682:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788664139.973695:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d52d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.973701:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664139.973724:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d526 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d52d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.973731:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c400030800/0xcd11f61c1413d526 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d52d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664139.973743:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664139.973746:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664139.973758:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664139.974116:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140406784:0@lo:103: 00000100:00100000:1.0:1788664139.974183:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664139.974359:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140406912:0@lo:103: 00000100:00100000:1.0:1788664139.974388:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664139.974893:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664139.975964:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140406784 00000100:00100000:3.0:1788664139.975975:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140406784 00010000:00010000:3.0:1788664139.976011:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d573 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d56c expref: 17 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.976056:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140406912 00000100:00100000:3.0:1788664139.976060:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140406912 00010000:00010000:3.0:1788664139.976073:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4029e3600/0xcd11f61c1413d52d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d526 expref: 18 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.976345:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788664139.976355:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+18:3637:x1875550140406784:12345-0@lo:103: 00010000:00010000:3.0:1788664139.976369:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664139.976375:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d573 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d56c expref: 18 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.976387:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d573 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d56c expref: 18 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.976406:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664139.976460:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+18:3637:x1875550140406784:12345-0@lo:103: Request processed in 107us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664139.976466:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788664139.976482:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788664139.976496:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303704700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+17:3638:x1875550140406912:12345-0@lo:103: 00010000:00010000:3.0:1788664139.976503:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664139.976508:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4029e3600/0xcd11f61c1413d52d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d526 expref: 17 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.976517:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4029e3600/0xcd11f61c1413d52d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d526 expref: 17 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.976529:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d637 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.976538:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d637 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788664139.976551:0:8443:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013577806s 00010000:00010000:3.0:1788664139.976556:0:8443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d637 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.976563:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d637 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.976571:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d637 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.976577:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d637 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.976583:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2600 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664139.976587:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d637 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.976594:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d637 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.976608:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d637 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.976617:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664139.976644:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303704700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+17:3638:x1875550140406912:12345-0@lo:103: Request processed in 149us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664139.976651:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788664139.976744:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d573 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d56c expref: 16 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664139.977026:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140406912:0@lo:103: 00000100:00100000:2.0:1788664139.977054:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140406784:0@lo:103: 00000100:00100000:3.0:1788664139.980997:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303707800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875550140406528:0@lo:104: 00010000:00010000:3.0:1788664139.981042:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e3600/0xcd11f61c1413d52d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d526 expref: 15 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664139.981055:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303704e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875550140406656:0@lo:104: 00010000:00010000:3.0:1788664139.981091:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d637 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.981103:0:6527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d637 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.981112:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d637 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664139.981118:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d637 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788664139.982749:0:9505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788664139.994162:0:9505:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788664139.994173:0:9505:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788664139.994213:0:9505:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788664139.994335:0:9505:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788664139.994355:0:9505:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788664139.994383:0:9505:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788664139.998751:0:9505:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788664139.999219:0:9505:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788664140.221891:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788664141.074814:0:9578:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788664141.077177:0:9578:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788664141.252270:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664141.382885:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664141.383153:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140407040:0@lo:41: 00000100:00100000:0.0:1788664141.383216:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664141.383306:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140407040 00000100:00100000:3.0:1788664141.383320:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140407040 00000100:00100000:3.0:1788664141.383372:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788664141.383382:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140407040:12345-0@lo:41: 00000004:00000024:3.0:1788664141.383413:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788664141.383467:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140407040:12345-0@lo:41: Request processed in 76us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664141.383475:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788664141.383517:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140407040:0@lo:41: 00010000:00010000:3.0:1788664142.275031:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664142.913041:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140407168:0@lo:41: 00000100:00100000:2.0:1788664142.913116:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664142.913245:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140407168 00000100:00100000:1.0:1788664142.913254:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140407168 00000100:00100000:1.0:1788664142.913308:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788664142.913318:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140407168:12345-0@lo:41: 00000004:00000024:1.0:1788664142.913356:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788664142.913408:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140407168:12345-0@lo:41: Request processed in 92us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664142.913415:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788664142.913493:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140407168:0@lo:41: 00010000:00010000:1.0:1788664143.295109:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664143.422082:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140407296:0@lo:13: 00000100:00100000:2.0:1788664143.422153:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664143.422855:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140407296 00000100:00100000:3.0:1788664143.422864:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140407296 00000100:00100000:3.0:1788664143.422959:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788664143.422969:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140407296:12345-0@lo:13: 00002000:00000024:3.0:1788664143.423013:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664143.423071:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140407296:12345-0@lo:13: Request processed in 103us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664143.423079:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788664143.423098:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140407424:0@lo:13: 00010000:00080000:3.0:1788664143.423137:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f4a80 x1875550140407296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664143.423179:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140407296:0@lo:13: 00000100:00100000:0.0:1788664143.423462:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788664143.423691:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664143.423700:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140407424 00000100:00100000:3.0:1788664143.423707:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140407424 00000100:00080000:2.0:1788664143.423736:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664143.423842:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788664143.423850:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140407424:12345-0@lo:13: 00002000:00000024:3.0:1788664143.423865:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664143.423898:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140407424:12345-0@lo:13: Request processed in 49us (436us total) trans 0 rc 0/0 00010000:00080000:0.0:1788664143.424014:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43526f480 x1875550140407424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664143.424030:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140407424:0@lo:13: 00000100:00100000:3.0:1788664143.424659:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788664144.317963:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664144.967138:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140407552:0@lo:400: 00000100:00100000:2.0:1788664144.968731:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664144.968813:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140408064:0@lo:400: 00000100:00100000:0.0:1788664144.969433:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140407552 00000100:00100000:0.0:1788664144.969441:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140407552 00000100:00100000:0.0:1788664144.969489:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788664144.969498:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:3639:x1875550140407552:12345-0@lo:400: 00000100:00100000:0.0:1788664144.969560:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:3639:x1875550140407552:12345-0@lo:400: Request processed in 64us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664144.969567:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788664144.969635:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664144.969677:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140408576:0@lo:400: 00000100:00100000:2.0:1788664144.969702:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664144.969740:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140407552:0@lo:400: 00000100:00100000:2.0:1788664144.969754:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788664144.969761:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140407936:0@lo:400: 00000100:00100000:2.0:1788664144.969807:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664144.969829:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140408448:0@lo:400: 00000100:00100000:2.0:1788664144.969863:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664144.971130:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140408064 00000100:00100000:0.0:1788664144.971140:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140408064 00000100:00100000:0.0:1788664144.971184:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788664144.971193:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140408064:12345-0@lo:400: 00000100:00100000:0.0:1788664144.971279:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140408064:12345-0@lo:400: Request processed in 87us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664144.971286:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788664144.971309:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140408576 00000100:00100000:0.0:1788664144.971313:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140408576 00000100:00100000:0.0:1788664144.971337:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140408448 00000100:00100000:0.0:1788664144.971341:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140408448 00000100:00100000:0.0:1788664144.971357:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788664144.971363:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140408576:12345-0@lo:400: 00000100:00100000:0.0:1788664144.971408:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140408576:12345-0@lo:400: Request processed in 44us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664144.971414:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788664144.971427:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788664144.971432:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140408448:12345-0@lo:400: 00000100:00100000:0.0:1788664144.971457:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140408448:12345-0@lo:400: Request processed in 25us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664144.971463:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788664144.971498:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3036f8380 x1875550140408448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664144.971512:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140408448:0@lo:400: 00000100:00100000:0.0:1788664144.971523:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140408064:0@lo:400: 00010000:00080000:0.0:1788664144.971533:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3036fbb80 x1875550140408576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664144.971540:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140408576:0@lo:400: 00000100:00100000:2.0:1788664144.972018:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140407680:0@lo:400: 00000100:00100000:2.0:1788664144.972059:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664144.972089:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140408192:0@lo:400: 00000100:00100000:2.0:1788664144.972109:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664144.972142:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140408704:0@lo:400: 00000100:00100000:2.0:1788664144.972170:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664144.972192:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788664144.972198:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140407808:0@lo:400: 00000100:00100000:3.0:1788664144.972671:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140407936 00000100:00100000:3.0:1788664144.972678:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140407936 00000100:00100000:3.0:1788664144.972714:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140407680 00000100:00100000:3.0:1788664144.972718:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140407680 00000100:00100000:3.0:1788664144.972730:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140408192 00000100:00100000:3.0:1788664144.972732:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140408192 00000100:00100000:3.0:1788664144.972755:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140408704 00000100:00100000:3.0:1788664144.972757:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140408704 00000100:00100000:3.0:1788664144.972785:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788664144.972795:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140407936:12345-0@lo:400: 00000100:00100000:3.0:1788664144.972859:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140407936:12345-0@lo:400: Request processed in 66us (3051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664144.972866:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788664144.972880:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788664144.972885:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140407680:12345-0@lo:400: 00000100:00100000:0.0:1788664144.973059:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788664144.973068:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140408192:12345-0@lo:400: 00000100:00100000:0.0:1788664144.973104:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140408192:12345-0@lo:400: Request processed in 38us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664144.973110:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788664144.973124:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788664144.973130:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140408704:12345-0@lo:400: 00000100:00100000:0.0:1788664144.973153:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140408704:12345-0@lo:400: Request processed in 24us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664144.973169:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788664144.974382:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664144.974427:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140408320:0@lo:400: 00000100:00100000:2.0:1788664144.974452:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664144.974472:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140408832:0@lo:400: 00000100:00100000:2.0:1788664144.974510:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788664144.974539:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3036f8e00 x1875550140408192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664144.974552:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140408192:0@lo:400: 00010000:00080000:2.0:1788664144.974564:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3036f8000 x1875550140408704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664144.974571:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140408704:0@lo:400: 00010000:00080000:0.0:1788664144.974738:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3036fb800 x1875550140407936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664144.974752:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140407936:0@lo:400: 00000100:00100000:3.0:1788664144.975043:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140407680:12345-0@lo:400: Request processed in 2157us (2983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664144.975050:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788664144.975070:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140408320 00000100:00100000:3.0:1788664144.975075:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140408320 00000100:00100000:3.0:1788664144.975102:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140408832 00000100:00100000:3.0:1788664144.975105:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140408832 00000100:00100000:3.0:1788664144.975118:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788664144.975125:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140408320:12345-0@lo:400: 00000100:00100000:3.0:1788664144.975154:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140408320:12345-0@lo:400: Request processed in 29us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664144.975160:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788664144.975181:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788664144.975186:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140408832:12345-0@lo:400: 00000100:00100000:3.0:1788664144.975212:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140408832:12345-0@lo:400: Request processed in 26us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664144.975217:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788664144.977449:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140407808 00000100:00100000:1.0:1788664144.977464:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140407808 00000100:00100000:1.0:1788664144.977521:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788664144.977531:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140407808:12345-0@lo:400: 00000100:00100000:1.0:1788664144.977622:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140407808:12345-0@lo:400: Request processed in 92us (3242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664144.977630:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788664144.978351:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788664144.978357:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664144.978394:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140407808:0@lo:400: 00010000:00080000:2.0:1788664144.978413:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3036fa300 x1875550140408320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664144.978424:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140408320:0@lo:400: 00010000:00080000:2.0:1788664144.978437:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3036f8700 x1875550140408832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664144.978446:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140408832:0@lo:400: 00010000:00080000:2.0:1788664144.978469:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3036f9c00 x1875550140407680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664144.978478:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140407680:0@lo:400: 00010000:00010000:3.0:1788664145.343708:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664146.369610:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664146.495714:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664146.495739:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140408960:0@lo:41: 00000100:00100000:3.0:1788664146.495834:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664146.496099:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140408960 00000100:00100000:0.0:1788664146.496106:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140408960 00000100:00100000:0.0:1788664146.496514:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788664146.496522:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140408960:12345-0@lo:41: 00000004:00000024:0.0:1788664146.496550:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788664146.496613:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140408960:12345-0@lo:41: Request processed in 91us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664146.496620:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788664146.496985:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140408960:0@lo:41: 00000001:02000400:0.0:1788664146.697337:0:9868:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1788664147.009374:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788664147.009382:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c42f78b000 from 39 10000000:01000000:1.0:1788664147.009389:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788664147.009435:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d63e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664147.009447:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d63e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664147.009569:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d63e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664147.009593:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303705880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140409088:0@lo:101: 00000100:00100000:1.0:1788664147.009669:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.009847:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411902600 going to sleep for 11 seconds 00000100:00100000:2.0:1788664147.009921:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140409088 00000100:00100000:2.0:1788664147.009929:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140409088 00000100:00100000:2.0:1788664147.010090:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788664147.010102:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140409088:12345-0@lo:101: 00010000:00010000:2.0:1788664147.010117:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664147.010131:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0ce00/0xcd11f61c1413d645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d63e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.010158:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0ce00/0xcd11f61c1413d645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d63e expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.010170:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0ce00/0xcd11f61c1413d645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d63e expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.010179:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0ce00, rc 0) 00000100:00100000:2.0:1788664147.010231:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140409088:12345-0@lo:101: Request processed in 131us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664147.010238:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788664147.010294:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303705880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140409088:0@lo:101: 00010000:00010000:0.0:1788664147.010313:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d63e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d645 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664147.010323:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d63e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d645 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664147.010389:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140409216:0@lo:501: 00000100:00100000:0.0:1788664147.010418:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.015835:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140409216 00000100:00100000:0.0:1788664147.015835:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664147.015851:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140409216 00000100:00100000:1.0:1788664147.015911:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788664147.015920:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140409216:12345-0@lo:501: 00000100:00100000:1.0:1788664147.016275:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140409216:12345-0@lo:501: Request processed in 354us (5854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664147.016284:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788664147.016353:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140409216:0@lo:501: 00000100:00100000:2.0:1788664147.016403:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140409344:0@lo:503: 00000100:00100000:2.0:1788664147.016582:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664147.016612:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42ebb5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788664147.016660:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140409344 00000100:00100000:1.0:1788664147.016665:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140409344 00000100:00100000:1.0:1788664147.016932:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788664147.016942:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140409344:12345-0@lo:503: 00000100:00100000:1.0:1788664147.017170:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140409344:12345-0@lo:503: Request processed in 229us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664147.017177:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788664147.017638:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140409344:0@lo:503: 00000100:00100000:1.0:1788664147.018981:0:9886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303706d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9886:1875550140409472:0@lo:502: 00000100:00100000:1.0:1788664147.019062:0:9886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.019108:0:9886:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411429000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.019126:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140409472 00000100:00100000:3.0:1788664147.019134:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140409472 00000100:00100000:3.0:1788664147.019178:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788664147.019196:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:9886:x1875550140409472:12345-0@lo:502: 00000100:00100000:3.0:1788664147.019327:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:9886:x1875550140409472:12345-0@lo:502: Request processed in 140us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.019337:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788664147.021938:0:9886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303706d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9886:1875550140409472:0@lo:502: 00000100:00100000:1.0:1788664147.022619:0:9886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303706d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9886:1875550140409600:0@lo:502: 00000100:00100000:1.0:1788664147.022841:0:9886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.022883:0:9886:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411429000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.023315:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140409600 00000100:00100000:3.0:1788664147.023324:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140409600 00000100:00100000:3.0:1788664147.023376:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788664147.023385:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:9886:x1875550140409600:12345-0@lo:502: 00000100:00100000:3.0:1788664147.023516:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:9886:x1875550140409600:12345-0@lo:502: Request processed in 131us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.023525:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788664147.023606:0:9886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303706d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9886:1875550140409600:0@lo:502: 00000040:00080000:1.0:1788664147.023652:0:9886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788664147.024152:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788664147.024178:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788664147.024188:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d63e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d645 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.024200:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d645 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664147.024210:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788664147.024212:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788664147.024215:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788664147.024242:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0c600/0xcd11f61c1413d64c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.024250:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c402a0c600/0xcd11f61c1413d64c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.024260:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c402a0c600/0xcd11f61c1413d64c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664147.024275:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140409728:0@lo:101: 00000100:00100000:2.0:1788664147.024315:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664147.028721:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42ebb5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.037325:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140409728 00000100:00100000:3.0:1788664147.037341:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140409728 00000100:00100000:3.0:1788664147.037407:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788664147.037417:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140409728:12345-0@lo:101: 00010000:00010000:3.0:1788664147.037465:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664147.037484:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d64c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.037515:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d64c expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.037526:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d64c expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.037536:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351ee200, rc 0) 00000100:00100000:3.0:1788664147.037612:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140409728:12345-0@lo:101: Request processed in 197us (13297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.037620:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788664147.037889:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140409728:0@lo:101: 00010000:00010000:2.0:1788664147.037911:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c402a0c600/0xcd11f61c1413d64c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.037921:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c402a0c600/0xcd11f61c1413d64c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664147.038025:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140409856:0@lo:501: 00000100:00100000:2.0:1788664147.038061:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664147.038093:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42ebb5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.038505:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140409856 00000100:00100000:3.0:1788664147.038510:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140409856 00000100:00100000:3.0:1788664147.038549:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788664147.038557:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140409856:12345-0@lo:501: 00000100:00100000:3.0:1788664147.038736:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140409856:12345-0@lo:501: Request processed in 179us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.038743:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788664147.042327:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140409856:0@lo:501: 00000100:00100000:0.0:1788664147.042388:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140409984:0@lo:503: 00000100:00100000:0.0:1788664147.042467:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.042518:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664147.042580:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140409984 00000100:00100000:2.0:1788664147.042587:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140409984 00000100:00100000:2.0:1788664147.042650:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788664147.042661:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140409984:12345-0@lo:503: 00000100:00100000:2.0:1788664147.042813:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140409984:12345-0@lo:503: Request processed in 153us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664147.042822:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788664147.043483:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140409984:0@lo:503: 00000100:00100000:0.0:1788664147.044326:0:9889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9889:1875550140410112:0@lo:502: 00000100:00100000:0.0:1788664147.044389:0:9889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.044426:0:9889:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4780 going to sleep for 11 seconds 00000100:00100000:2.0:1788664147.044485:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140410112 00000100:00100000:2.0:1788664147.044492:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140410112 00000100:00100000:2.0:1788664147.044639:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788664147.044649:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:9889:x1875550140410112:12345-0@lo:502: 00000100:00100000:2.0:1788664147.044761:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:9889:x1875550140410112:12345-0@lo:502: Request processed in 113us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664147.044791:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788664147.044866:0:9889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9889:1875550140410112:0@lo:502: 00000020:01000000:3.0:1788664147.044906:0:9889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664147.044915:0:9889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664147.044918:0:9889:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788664147.044926:0:9889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788664147.044928:0:9889:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788664147.044945:0:9889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9889:1875550140410240:0@lo:502: 00000100:00100000:3.0:1788664147.044988:0:9889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.047613:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140410240 00000100:00100000:0.0:1788664147.047633:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140410240 00000100:00100000:0.0:1788664147.047681:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788664147.047693:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:9889:x1875550140410240:12345-0@lo:502: 00000100:00100000:0.0:1788664147.047860:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:9889:x1875550140410240:12345-0@lo:502: Request processed in 169us (2869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664147.047868:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788664147.051415:0:9889:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f764480 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.051613:0:9889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9889:1875550140410240:0@lo:502: 00000020:01000000:3.0:1788664147.051672:0:9889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664147.051684:0:9889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664147.051686:0:9889:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788664147.051694:0:9889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788664147.052912:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788664147.052944:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788664147.052955:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0c600/0xcd11f61c1413d64c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664147.052968:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c402a0c600/0xcd11f61c1413d64c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664147.052980:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788664147.052983:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c42d99f800 from 39 10000000:01000000:0.0:1788664147.052986:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788664147.053024:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d65a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664147.053033:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d65a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664147.053056:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d65a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664147.053077:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140410368:0@lo:101: 00000100:00100000:0.0:1788664147.053141:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.053183:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.053325:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140410368 00000100:00100000:3.0:1788664147.053333:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140410368 00000100:00100000:3.0:1788664147.053378:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788664147.053387:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140410368:12345-0@lo:101: 00010000:00010000:3.0:1788664147.053400:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664147.053413:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4351ee000/0xcd11f61c1413d661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d65a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.053436:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4351ee000/0xcd11f61c1413d661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d65a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.053459:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4351ee000/0xcd11f61c1413d661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d65a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.053468:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351ee000, rc 0) 00000100:00100000:3.0:1788664147.053503:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140410368:12345-0@lo:101: Request processed in 118us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.053510:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788664147.053641:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140410368:0@lo:101: 00010000:00010000:0.0:1788664147.053656:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d65a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664147.053663:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d65a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664147.053717:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140410496:0@lo:501: 00000100:00100000:0.0:1788664147.053744:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.053791:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.054978:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140410496 00000100:00100000:3.0:1788664147.054987:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140410496 00000100:00100000:3.0:1788664147.055036:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788664147.055046:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140410496:12345-0@lo:501: 00000100:00100000:3.0:1788664147.055214:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140410496:12345-0@lo:501: Request processed in 169us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.055221:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788664147.055687:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140410496:0@lo:501: 00000100:00100000:0.0:1788664147.055731:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140410624:0@lo:503: 00000100:00100000:0.0:1788664147.055816:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664147.055866:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140410624 00000100:00100000:3.0:1788664147.055871:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140410624 00000100:00100000:0.0:1788664147.056285:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.056728:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788664147.056737:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140410624:12345-0@lo:503: 00000100:00100000:3.0:1788664147.057169:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140410624:12345-0@lo:503: Request processed in 432us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.057177:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788664147.057281:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140410624:0@lo:503: 00000100:00100000:0.0:1788664147.057552:0:9890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9890:1875550140410752:0@lo:502: 00000100:00100000:0.0:1788664147.057594:0:9890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.057616:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140410752 00000100:00100000:0.0:1788664147.057635:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140410752 00000100:00100000:0.0:1788664147.059414:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788664147.059431:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:9890:x1875550140410752:12345-0@lo:502: 00000100:00100000:0.0:1788664147.059590:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:9890:x1875550140410752:12345-0@lo:502: Request processed in 166us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664147.059597:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788664147.061587:0:9890:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664147.061636:0:9890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9890:1875550140410752:0@lo:502: 00000100:00100000:2.0:1788664147.061741:0:9890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9890:1875550140410880:0@lo:502: 00000100:00100000:2.0:1788664147.061832:0:9890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664147.061857:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140410880 00000100:00100000:3.0:1788664147.061865:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140410880 00000100:00100000:2.0:1788664147.061873:0:9890:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42ebb5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.061973:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788664147.061986:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+18:9890:x1875550140410880:12345-0@lo:502: 00000100:00100000:3.0:1788664147.062115:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+18:9890:x1875550140410880:12345-0@lo:502: Request processed in 132us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.062124:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788664147.062186:0:9890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9890:1875550140410880:0@lo:502: 00000040:00080000:2.0:1788664147.062335:0:9890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788664147.062438:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788664147.062705:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788664147.062717:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d65a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664147.062729:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664147.062739:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788664147.062741:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c42d99f800 from 6 10000000:01000000:0.0:1788664147.062744:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788664147.062865:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664147.063007:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664147.063019:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664147.063037:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140411008:0@lo:101: 00000100:00100000:0.0:1788664147.063074:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.063108:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664147.063152:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140411008 00000100:00100000:2.0:1788664147.063158:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140411008 00000100:00100000:2.0:1788664147.063591:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788664147.063602:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140411008:12345-0@lo:101: 00010000:00010000:2.0:1788664147.063613:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664147.063638:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0c000/0xcd11f61c1413d66f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d668 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.063661:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0c000/0xcd11f61c1413d66f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d668 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.063672:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0c000/0xcd11f61c1413d66f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d668 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.063681:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c000, rc 0) 00000100:00100000:2.0:1788664147.063735:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+19:6508:x1875550140411008:12345-0@lo:101: Request processed in 135us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664147.063742:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788664147.063820:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140411008:0@lo:101: 00010000:00010000:0.0:1788664147.063841:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d66f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664147.063850:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d66f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664147.063901:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140411136:0@lo:256: 00000100:00100000:0.0:1788664147.063938:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.068673:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.070565:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140411136 00000100:00100000:3.0:1788664147.070581:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140411136 00000100:00100000:3.0:1788664147.070648:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788664147.070659:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+19:6508:x1875550140411136:12345-0@lo:256: 20000000:01000000:3.0:1788664147.070683:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788664147.070717:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788664147.070720:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788664147.070907:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+19:6508:x1875550140411136:12345-0@lo:256: Request processed in 249us (6967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.070915:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788664147.070962:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140411136:0@lo:256: 10000000:01000000:3.0:1788664147.071204:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788664147.071214:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d66f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.071226:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d66f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664147.071235:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788664147.071237:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1788664147.071240:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788664147.071270:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.071279:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.071288:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664147.071307:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140411264:0@lo:101: 00000100:00100000:3.0:1788664147.071341:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664147.071354:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f764e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.071373:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140411264 00000100:00100000:3.0:1788664147.071376:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140411264 00000100:00100000:3.0:1788664147.071394:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788664147.071400:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+19:6508:x1875550140411264:12345-0@lo:101: 00010000:00010000:3.0:1788664147.071409:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664147.071420:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4351ef400/0xcd11f61c1413d67d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d676 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.071447:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4351ef400/0xcd11f61c1413d67d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d676 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.071457:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4351ef400/0xcd11f61c1413d67d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d676 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.071466:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351ef400, rc 0) 00000100:00100000:3.0:1788664147.071497:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140411264:12345-0@lo:101: Request processed in 97us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.071503:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788664147.071526:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140411264:0@lo:101: 00010000:00010000:3.0:1788664147.071538:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d676 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d67d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.071546:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d676 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d67d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664147.071668:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140411392:0@lo:501: 00000100:00100000:3.0:1788664147.071693:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664147.071720:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f764e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.071735:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140411392 00000100:00100000:3.0:1788664147.071738:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140411392 00000100:00100000:3.0:1788664147.071756:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788664147.071762:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140411392:12345-0@lo:501: 00000100:00100000:3.0:1788664147.071886:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140411392:12345-0@lo:501: Request processed in 124us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.071893:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788664147.071930:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140411392:0@lo:501: 00000100:00100000:3.0:1788664147.071957:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140411520:0@lo:503: 00000100:00100000:3.0:1788664147.072248:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664147.072269:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4126d1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.072287:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140411520 00000100:00100000:3.0:1788664147.072291:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140411520 00000100:00100000:3.0:1788664147.072309:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788664147.072313:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140411520:12345-0@lo:503: 00000100:00100000:3.0:1788664147.072390:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140411520:12345-0@lo:503: Request processed in 75us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.072397:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788664147.072428:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140411520:0@lo:503: 00000100:00100000:3.0:1788664147.072606:0:9891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9891:1875550140411648:0@lo:502: 00000100:00100000:3.0:1788664147.072650:0:9891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664147.072668:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140411648 00000100:00100000:3.0:1788664147.072672:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140411648 00000100:00100000:3.0:1788664147.072689:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788664147.072695:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+20:9891:x1875550140411648:12345-0@lo:502: 00000100:00100000:3.0:1788664147.073434:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+20:9891:x1875550140411648:12345-0@lo:502: Request processed in 736us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.073443:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788664147.073484:0:9891:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c435203e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.073499:0:9891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9891:1875550140411648:0@lo:502: 00000020:01000000:3.0:1788664147.073528:0:9891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788664147.073536:0:9891:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788664147.073542:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664147.073550:0:9891:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788664147.073559:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788664147.073562:0:9891:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:3.0:1788664147.073593:0:9891:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788664147.073596:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788664147.073611:0:9891:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff93c3028d99c0) 00000020:00000080:3.0:1788664147.073644:0:9891:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788664147.073650:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788664147.073861:0:9891:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788664147.073867:0:9891:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788664147.073884:0:9891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd11f61c1413d68b 00010000:00080000:3.0:1788664147.073913:0:9891:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c43f7cf800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788664147.074302:0:9891:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788664147.074442:0:9891:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788664147.074454:0:9891:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788664147.074621:0:9891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788664147.075164:0:9891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788664147.075320:0:9891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788664147.075427:0:9891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788664147.075864:0:9893:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788664147.075869:0:9893:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788664147.077439:0:9891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788664147.077453:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788664147.077495:0:9891:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788664147.077698:0:9891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd11f61c1413d692 00000100:00080000:3.0:1788664147.077874:0:9891:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788664147.077881:0:9891:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93c43f7cf800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788664147.077918:0:9891:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c4367f6a00 x1875550140411776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788664147.077944:0:9891:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788664147.078038:0:9891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664147.078044:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664147.078051:0:9891:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788664147.078056:0:9891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664147.078060:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664147.078061:0:9891:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788664147.078065:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788664147.078191:0:9891:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788664147.078195:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140411776:0@lo:8: 00000100:00100000:3.0:1788664147.078223:0:9891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9891:1875550140411904:0@lo:502: 00000100:00100000:0.0:1788664147.078342:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.078409:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140411776 00000100:00100000:1.0:1788664147.078414:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140412032:0@lo:400: 00000100:00100000:0.0:1788664147.078417:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140411776 00000100:00100000:1.0:1788664147.078453:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.078481:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140412544:0@lo:400: 00000100:00100000:0.0:1788664147.078496:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788664147.078507:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.078508:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1875550140411776:12345-0@lo:8: 00000100:00100000:1.0:1788664147.078526:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140413056:0@lo:400: 00010000:00080000:0.0:1788664147.078538:0:8426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000100:00100000:1.0:1788664147.078552:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788664147.078567:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd11f61c1413d699 00000100:00100000:1.0:1788664147.078573:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788664147.078581:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140412416:0@lo:400: 00002000:00100000:0.0:1788664147.078582:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff93c4352e1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788664147.078590:0:8426:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1788664147.078593:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788664147.078634:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.078660:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140412928:0@lo:400: 00000100:00100000:1.0:1788664147.078681:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.078721:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140412160:0@lo:400: 00000100:00100000:1.0:1788664147.078745:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.078761:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140412672:0@lo:400: 00000100:00100000:1.0:1788664147.078807:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.078824:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43535bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140413184:0@lo:400: 00000100:00100000:1.0:1788664147.078842:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.078859:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788664147.078864:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140412288:0@lo:400: 00000100:00100000:1.0:1788664147.078882:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.078890:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140412800:0@lo:400: 00000100:00100000:1.0:1788664147.078906:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.078927:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140412032 00000100:00100000:1.0:1788664147.078931:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140412032 00000100:00100000:1.0:1788664147.078955:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140412544 00000100:00100000:1.0:1788664147.078958:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140412544 00000100:00100000:1.0:1788664147.078979:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140413056 00000100:00100000:1.0:1788664147.078981:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140413056 00000100:00100000:1.0:1788664147.079065:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140412672 00000100:00100000:1.0:1788664147.079128:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140412672 00000100:00100000:1.0:1788664147.079144:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140413184 00000100:00100000:1.0:1788664147.079147:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140413184 00000100:00100000:1.0:1788664147.079157:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140412288 00000100:00100000:1.0:1788664147.079159:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140412288 00000100:00100000:1.0:1788664147.079169:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788664147.079175:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c435358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140412032:12345-0@lo:400: 00000100:00100000:1.0:1788664147.079222:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c435358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140412032:12345-0@lo:400: Request processed in 47us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664147.079235:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788664147.079250:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788664147.079255:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c435358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140412544:12345-0@lo:400: 00000100:00100000:1.0:1788664147.079280:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c435358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140412544:12345-0@lo:400: Request processed in 26us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664147.079286:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788664147.079553:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788664147.079561:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c435359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140413056:12345-0@lo:400: 00000100:00100000:1.0:1788664147.079593:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c435359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140413056:12345-0@lo:400: Request processed in 34us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664147.079599:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788664147.079611:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788664147.079617:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c435359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140412672:12345-0@lo:400: 00000100:00100000:1.0:1788664147.079661:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c435359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140412672:12345-0@lo:400: Request processed in 44us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664147.079666:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788664147.079678:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788664147.079683:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c435359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140413184:12345-0@lo:400: 00000100:00100000:1.0:1788664147.079708:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c435359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140413184:12345-0@lo:400: Request processed in 25us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664147.079713:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788664147.079723:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788664147.079729:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140412288:12345-0@lo:400: 00000100:00100000:1.0:1788664147.079753:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140412288:12345-0@lo:400: Request processed in 24us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664147.079795:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788664147.079821:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140412416 00000100:00100000:1.0:1788664147.079826:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140412416 00000100:00100000:1.0:1788664147.079851:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140412160 00000100:00100000:1.0:1788664147.079854:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140412160 00000100:00100000:1.0:1788664147.079867:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788664147.079873:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c435359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140412416:12345-0@lo:400: 00000100:00100000:1.0:1788664147.079908:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c435359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140412416:12345-0@lo:400: Request processed in 35us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664147.079913:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788664147.079925:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788664147.079931:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140412160:12345-0@lo:400: 00000100:00100000:1.0:1788664147.079959:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140412160:12345-0@lo:400: Request processed in 29us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664147.079964:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788664147.079980:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788664147.080197:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1788664147.080226:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664147.080231:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00100000:0.0:1788664147.080366:0:8426:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:1.0:1788664147.080374:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303705880 x1875550140412288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664147.080390:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140412288:0@lo:400: 00000100:00100000:1.0:1788664147.080402:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140412160:0@lo:400: 00010000:00080000:1.0:1788664147.080413:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303707800 x1875550140412672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664147.080421:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140412672:0@lo:400: 00010000:00080000:1.0:1788664147.080441:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43535bb80 x1875550140413184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664147.080449:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43535bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140413184:0@lo:400: 00000100:00100000:1.0:1788664147.080489:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140412416:0@lo:400: 00010000:00080000:1.0:1788664147.080504:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303706d80 x1875550140412032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664147.080513:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140412032:0@lo:400: 00010000:00080000:1.0:1788664147.080527:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303704e00 x1875550140412544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664147.080535:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140412544:0@lo:400: 00010000:00080000:1.0:1788664147.080549:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303706a00 x1875550140413056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664147.080557:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140413056:0@lo:400: 00002000:00080000:0.0:1788664147.080621:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788664147.080660:0:8426:0:(import.c:65:import_set_state_nolock()) ffff93c4352e6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788664147.080728:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1875550140411776:12345-0@lo:8: Request processed in 2223us (2387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664147.080736:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788664147.080752:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140412928 00000100:00100000:0.0:1788664147.080762:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140412928 00000100:00100000:3.0:1788664147.080791:0:9891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.080812:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140412800 00000100:00100000:0.0:1788664147.080817:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140412800 00000100:00100000:3.0:1788664147.080835:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140411904 00000100:00100000:0.0:1788664147.080839:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788664147.080841:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140411904 00000100:00100000:0.0:1788664147.080848:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140412928:12345-0@lo:400: 00000100:00100000:3.0:1788664147.080873:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788664147.080881:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+20:9891:x1875550140411904:12345-0@lo:502: 00000100:00100000:3.0:1788664147.080980:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+20:9891:x1875550140411904:12345-0@lo:502: Request processed in 99us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.080987:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788664147.081172:0:9891:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4126d1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.081187:0:9891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9891:1875550140411904:0@lo:502: 00000020:01000000:3.0:1788664147.081214:0:9891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664147.081222:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664147.081224:0:9891:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788664147.081230:0:9891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00080000:1.0:1788664147.081283:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:3.0:1788664147.081295:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1788664147.081320:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788664147.081332:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d676 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d67d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788664147.081332:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f6a00 x1875550140411776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788664157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788664147.081355:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d67d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664147.081355:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664147.081365:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 10000000:01000000:3.0:1788664147.081367:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 00000100:00080000:1.0:1788664147.081373:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 10000000:01000000:3.0:1788664147.081377:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c40641a800 from 39 00000100:00080000:1.0:1788664147.081380:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 10000000:01000000:3.0:1788664147.081382:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00080000:1.0:1788664147.081385:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c43f7cf800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788664147.081396:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788664147.081401:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140411776:0@lo:8: 00010000:00010000:3.0:1788664147.081410:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ef800/0xcd11f61c1413d6a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.081420:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4351ef800/0xcd11f61c1413d6a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.081429:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4351ef800/0xcd11f61c1413d6a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788664147.081436:0:9893:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788664147.081447:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140413312:0@lo:101: 00000100:00100000:3.0:1788664147.081483:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788664147.081498:0:9893:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 242218725502ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788664147.081507:0:9893:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788664147.081509:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4126d1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.081526:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140413312 00000100:00100000:3.0:1788664147.081529:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140413312 00000100:00100000:3.0:1788664147.081556:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788664147.081563:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140413312:12345-0@lo:101: 00010000:00010000:3.0:1788664147.081572:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664147.081584:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4351efa00/0xcd11f61c1413d6a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d6a0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.081794:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4351efa00/0xcd11f61c1413d6a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d6a0 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.081807:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4351efa00/0xcd11f61c1413d6a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d6a0 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.081816:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351efa00, rc 0) 00000100:00100000:3.0:1788664147.081860:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140413312:12345-0@lo:101: Request processed in 298us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664147.081871:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140412928:12345-0@lo:400: Request processed in 1022us (3186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.081876:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788664147.081888:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788664147.081909:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788664147.081918:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140412800:12345-0@lo:400: 00000100:00100000:3.0:1788664147.081920:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140413312:0@lo:101: 00010000:00010000:3.0:1788664147.081938:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4351ef800/0xcd11f61c1413d6a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d6a7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.081949:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4351ef800/0xcd11f61c1413d6a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d6a7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664147.081960:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140412800:12345-0@lo:400: Request processed in 43us (3051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664147.081967:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788664147.082010:0:9894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875550140413440:0@lo:700: 00000100:00100000:0.0:1788664147.082037:0:9894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.082054:0:9894:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.082154:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140413568:0@lo:501: 00000100:00100000:3.0:1788664147.082180:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664147.082211:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4126d1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.082225:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140413440 00000100:00100000:3.0:1788664147.082229:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140413440 00000100:00100000:3.0:1788664147.082265:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664147.082272:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9894:x1875550140413440:12345-0@lo:700: 00000100:00100000:3.0:1788664147.082300:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8436:1875550140413696:0@lo:700: 00000100:00100000:3.0:1788664147.082331:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664147.082348:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c40385e3c0 going to sleep for 11 seconds 00000100:00080000:3.0:1788664147.082358:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664147.082377:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140413696 00000100:00100000:3.0:1788664147.082380:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140413696 00000100:00100000:3.0:1788664147.082407:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664147.082414:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8436:x1875550140413696:12345-0@lo:700: 00000100:00100000:0.0:1788664147.082919:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140413568 00000100:00100000:0.0:1788664147.082925:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140413568 00000100:00100000:3.0:1788664147.082969:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788664147.082978:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c420ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140413568:12345-0@lo:501: 00010000:00080000:1.0:1788664147.083031:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303704380 x1875550140412800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664147.083045:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140412800:0@lo:400: 00010000:00080000:1.0:1788664147.083078:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303707b80 x1875550140412928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664147.083088:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140412928:0@lo:400: 00000100:00100000:3.0:1788664147.083361:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c420ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140413568:12345-0@lo:501: Request processed in 385us (1180us total) trans 0 rc 0/0 00000004:00080000:1.0:1788664147.084686:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788664147.085808:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788664147.085863:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140413568:0@lo:501: 00000100:00100000:0.0:1788664147.085977:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140413824:0@lo:503: 00000100:00100000:0.0:1788664147.086034:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.086075:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.086143:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140413824 00000100:00100000:3.0:1788664147.086151:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140413824 00000100:00100000:3.0:1788664147.086195:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788664147.086203:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c410474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140413824:12345-0@lo:503: 00000100:00100000:3.0:1788664147.086337:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c410474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140413824:12345-0@lo:503: Request processed in 134us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.086344:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788664147.086384:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140413824:0@lo:503: 00000100:00100000:1.0:1788664147.087359:0:9896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43535bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9896:1875550140413952:0@lo:502: 00000100:00100000:1.0:1788664147.087419:0:9896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.087458:0:9896:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411429540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664147.087642:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140413952 00000100:00100000:2.0:1788664147.087648:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140413952 00000100:00100000:2.0:1788664147.087685:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788664147.087694:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c410475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+21:9896:x1875550140413952:12345-0@lo:502: 00000100:00100000:2.0:1788664147.087856:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c410475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+21:9896:x1875550140413952:12345-0@lo:502: Request processed in 163us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664147.087864:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788664147.088272:0:9896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43535bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9896:1875550140413952:0@lo:502: 00000100:00100000:0.0:1788664147.088329:0:9896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9896:1875550140414080:0@lo:502: 00000100:00100000:0.0:1788664147.088373:0:9896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.088450:0:9896:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4540 going to sleep for 11 seconds 00000100:00100000:1.0:1788664147.088500:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140414080 00000100:00100000:1.0:1788664147.088506:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140414080 00000100:00100000:1.0:1788664147.088762:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788664147.088793:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c421997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:9896:x1875550140414080:12345-0@lo:502: 00000100:00100000:1.0:1788664147.088890:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c421997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:9896:x1875550140414080:12345-0@lo:502: Request processed in 120us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664147.088898:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788664147.089008:0:9896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9896:1875550140414080:0@lo:502: 00000040:00080000:0.0:1788664147.089029:0:9896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788664147.089142:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788664147.089164:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788664147.089174:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ef800/0xcd11f61c1413d6a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d6a7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.089185:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4351ef800/0xcd11f61c1413d6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d6a7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664147.089194:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788664147.089197:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c40641a800 from 6 10000000:01000000:3.0:1788664147.089199:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788664147.089223:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.089231:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664147.089240:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664147.089264:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140414208:0@lo:101: 00000100:00100000:3.0:1788664147.089293:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664147.089934:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4123b5780 going to sleep for 11 seconds 00000100:00100000:2.0:1788664147.089965:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140414208 00000100:00100000:2.0:1788664147.089972:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140414208 00000100:00100000:2.0:1788664147.090003:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788664147.090011:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140414208:12345-0@lo:101: 00010000:00010000:2.0:1788664147.090032:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664147.090045:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0d800/0xcd11f61c1413d6b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d6ae expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.090069:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0d800/0xcd11f61c1413d6b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d6ae expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.090080:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0d800/0xcd11f61c1413d6b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d6ae expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.090088:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d800, rc 0) 00000100:00100000:2.0:1788664147.090129:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140414208:12345-0@lo:101: Request processed in 118us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664147.090136:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 40000000:02000000:1.0:1788664147.090280:0:6518:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1788664147.090507:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140414208:0@lo:101: 00010000:00010000:2.0:1788664147.090525:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d6b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.090535:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d6b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664147.090600:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140414336:0@lo:256: 00000100:00100000:2.0:1788664147.090911:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664147.090938:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42ebb5480 going to sleep for 11 seconds 00000100:00100000:2.0:1788664147.090953:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140414336 00000100:00100000:2.0:1788664147.090958:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140414336 00000100:00100000:2.0:1788664147.090988:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788664147.090995:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140414336:12345-0@lo:256: 20000000:01000000:2.0:1788664147.091018:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788664147.091032:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788664147.091035:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788664147.091111:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140414336:12345-0@lo:256: Request processed in 116us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664147.091118:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788664147.091151:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140414336:0@lo:256: 10000000:01000000:2.0:1788664147.091435:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788664147.091444:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d6b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.091454:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d6b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664147.091463:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788664147.091466:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788664147.091469:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788664147.091491:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0c400/0xcd11f61c1413d6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.091498:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c402a0c400/0xcd11f61c1413d6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.091506:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c402a0c400/0xcd11f61c1413d6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664147.091518:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140414464:0@lo:101: 00000100:00100000:2.0:1788664147.091545:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664147.091563:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42ebb5480 going to sleep for 11 seconds 00000100:00100000:2.0:1788664147.091583:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140414464 00000100:00100000:2.0:1788664147.091587:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140414464 00000100:00100000:2.0:1788664147.091611:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788664147.091617:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140414464:12345-0@lo:101: 00010000:00010000:2.0:1788664147.091634:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664147.091645:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d6c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d6bc expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.091662:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d6bc expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.091671:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d6bc expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.091678:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d200, rc 0) 00000100:00100000:2.0:1788664147.091708:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140414464:12345-0@lo:101: Request processed in 91us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664147.091713:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788664147.091743:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140414464:0@lo:101: 00010000:00010000:2.0:1788664147.091754:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c402a0c400/0xcd11f61c1413d6bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d6c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.091762:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c402a0c400/0xcd11f61c1413d6bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d6c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664147.091836:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140414592:0@lo:501: 00000100:00100000:2.0:1788664147.091860:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664147.091880:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303711c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664147.091891:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140414592 00000100:00100000:2.0:1788664147.091900:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140414592 00000100:00100000:2.0:1788664147.091925:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788664147.091932:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140414592:12345-0@lo:501: 00000100:00100000:2.0:1788664147.092037:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140414592:12345-0@lo:501: Request processed in 105us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664147.092044:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788664147.092073:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140414592:0@lo:501: 00000100:00100000:2.0:1788664147.092101:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140414720:0@lo:503: 00000100:00100000:2.0:1788664147.092139:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664147.092151:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303711c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664147.092161:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140414720 00000100:00100000:2.0:1788664147.092165:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140414720 00000100:00100000:2.0:1788664147.093277:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788664147.093298:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140414720:12345-0@lo:503: 00000100:00100000:2.0:1788664147.093413:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140414720:12345-0@lo:503: Request processed in 123us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664147.093421:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788664147.093480:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140414720:0@lo:503: 00000100:00100000:2.0:1788664147.094410:0:9898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9898:1875550140414848:0@lo:502: 00000100:00100000:2.0:1788664147.094470:0:9898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664147.094501:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140414848 00000100:00100000:2.0:1788664147.094506:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140414848 00000100:00100000:2.0:1788664147.094542:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788664147.094552:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+23:9898:x1875550140414848:12345-0@lo:502: 00000100:00100000:2.0:1788664147.094656:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+23:9898:x1875550140414848:12345-0@lo:502: Request processed in 106us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664147.094672:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788664147.094716:0:9898:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303711180 going to sleep for 11 seconds 00000100:00100000:2.0:1788664147.094730:0:9898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9898:1875550140414848:0@lo:502: 00000020:01000000:2.0:1788664147.094756:0:9898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788664147.094764:0:9898:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788664147.094790:0:9898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664147.094793:0:9898:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788664147.094798:0:9898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788664147.094803:0:9898:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:2.0:1788664147.094824:0:9898:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788664147.094828:0:9898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788664147.094843:0:9898:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93c302884d40) 00000020:00000080:2.0:1788664147.094867:0:9898:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1788664147.094873:0:9898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788664147.094974:0:9898:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788664147.094980:0:9898:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788664147.094987:0:9898:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413d6d1 00010000:00080000:2.0:1788664147.095016:0:9898:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c303730000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788664147.096452:0:9898:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1788664147.096584:0:9898:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788664147.096597:0:9898:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788664147.096815:0:9898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788664147.096946:0:9898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788664147.097076:0:9898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788664147.097162:0:9898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788664147.101540:0:9899:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788664147.101547:0:9899:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1788664147.102910:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8436:x1875550140413696:12345-0@lo:700: Request processed in 20490us (20572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664147.102925:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788664147.103041:0:8436:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f5180 x1875550140413696/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788664163 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664147.103058:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8436:1875550140413696:0@lo:700: 40000000:02000000:3.0:1788664147.103074:0:8436:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000020:00000080:2.0:1788664147.107469:0:9898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788664147.107490:0:9898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788664147.107540:0:9898:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788664147.107570:0:9898:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd11f61c1413d6d8 00000100:00080000:2.0:1788664147.107593:0:9898:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788664147.107600:0:9898:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c303730000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664147.107649:0:9898:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c302b44e00 x1875550140414976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788664147.107675:0:9898:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788664147.107733:0:9898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664147.107737:0:9898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664147.107739:0:9898:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788664147.107742:0:9898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664147.107746:0:9898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664147.107747:0:9898:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788664147.107749:0:9898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788664147.107751:0:9898:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788664147.107792:0:9898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9898:1875550140415104:0@lo:502: 00000100:00100000:2.0:1788664147.107874:0:9898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664147.107914:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140415104 00000100:00100000:2.0:1788664147.107919:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140415104 00000100:00100000:2.0:1788664147.107958:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788664147.107967:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+23:9898:x1875550140415104:12345-0@lo:502: 00000100:00100000:2.0:1788664147.108081:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+23:9898:x1875550140415104:12345-0@lo:502: Request processed in 114us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664147.108088:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788664147.108138:0:9898:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42b933cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664147.108174:0:9898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:9898:1875550140415104:0@lo:502: 00000100:00100000:1.0:1788664147.111159:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140414976:0@lo:8: 00000100:00100000:1.0:1788664147.111281:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.111359:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140414976 00000100:00100000:1.0:1788664147.111367:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140414976 00000100:00100000:1.0:1788664147.111403:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788664147.111410:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c435359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1875550140414976:12345-0@lo:8: 00010000:00080000:1.0:1788664147.111441:0:8426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:1.0:1788664147.111470:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd11f61c1413d6df 00002000:00100000:1.0:1788664147.111482:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93c302983800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788664147.111487:0:8426:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788664147.111489:0:8426:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788664147.111560:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788664147.111585:0:8426:0:(import.c:65:import_set_state_nolock()) ffff93c302983000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664147.111649:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c435359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1875550140414976:12345-0@lo:8: Request processed in 238us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664147.111657:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788664147.111698:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b44e00 x1875550140414976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788664157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664147.111709:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664147.111717:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788664147.111724:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788664147.111728:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788664147.111731:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c303730000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788664147.111743:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788664147.111749:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140414976:0@lo:8: 00000020:01000000:2.0:1788664147.113485:0:9898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664147.113500:0:9898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664147.113502:0:9898:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788664147.113507:0:9898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1788664147.113591:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1788664147.113632:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788664147.113644:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0c400/0xcd11f61c1413d6bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d6c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.113656:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c402a0c400/0xcd11f61c1413d6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d6c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664147.113666:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788664147.113669:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff93c422744d40 from 1 10000000:01000000:2.0:1788664147.113671:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788664147.113704:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0d600/0xcd11f61c1413d6e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.113713:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c402a0d600/0xcd11f61c1413d6e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.113724:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c402a0d600/0xcd11f61c1413d6e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664147.113745:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140415232:0@lo:101: 00000100:00100000:2.0:1788664147.113822:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664147.113847:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42b933cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664147.113867:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140415232 00000100:00100000:2.0:1788664147.113872:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140415232 00000100:00100000:2.0:1788664147.113914:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788664147.113922:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140415232:12345-0@lo:101: 00010000:00010000:2.0:1788664147.113934:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664147.113945:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d6ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d6e6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.113980:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d6e6 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.113991:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d6e6 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.113999:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d000, rc 0) 00000100:00100000:2.0:1788664147.114036:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140415232:12345-0@lo:101: Request processed in 115us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664147.114043:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788664147.114089:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140415232:0@lo:101: 00010000:00010000:2.0:1788664147.114103:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c402a0d600/0xcd11f61c1413d6e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d6ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.114112:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c402a0d600/0xcd11f61c1413d6e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d6ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664147.114166:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140415360:0@lo:501: 00000004:00080000:3.0:1788664147.116725:0:9899:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788664147.116847:0:9899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 242254074809ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788664147.116855:0:9899:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788664147.117243:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664147.117285:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42b933cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664147.117305:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140415360 00000100:00100000:2.0:1788664147.117313:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140415360 00000100:00100000:2.0:1788664147.117359:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788664147.117368:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140415360:12345-0@lo:501: 00000100:00100000:2.0:1788664147.117464:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140415360:12345-0@lo:501: Request processed in 97us (223us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788664147.117482:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788664147.117532:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140415360:0@lo:501: 10000000:01000000:2.0:1788664147.117566:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788664147.117580:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0d600/0xcd11f61c1413d6e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d6ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664147.117592:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c402a0d600/0xcd11f61c1413d6e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d6ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664147.121542:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43535aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140415488:0@lo:13: 00000100:00100000:1.0:1788664147.121609:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788664147.121673:0:9900:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788664147.121697:0:9900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c435358a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9900:1875550140415616:0@lo:7: 00000100:00100000:1.0:1788664147.121723:0:9900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.121737:0:9900:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43518f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.124823:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140415488 00000100:00100000:3.0:1788664147.124840:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140415488 00000100:00100000:0.0:1788664147.124845:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140415616 00000100:00100000:0.0:1788664147.124852:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140415616 00000100:00100000:3.0:1788664147.124925:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788664147.124926:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788664147.124944:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c435358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:9900:x1875550140415616:12345-0@lo:7: 00000100:00100000:3.0:1788664147.124945:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875550140415488:12345-0@lo:13: 00002000:00000024:3.0:1788664147.124984:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1788664147.125074:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875550140415488:12345-0@lo:13: Request processed in 138us (3463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.125083:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788664147.125167:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43535aa00 x1875550140415488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664147.125189:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43535aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140415488:0@lo:13: 00000100:00080000:1.0:1788664147.128080:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1788664147.130067:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788664147.130079:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788664147.130273:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9894:x1875550140413440:12345-0@lo:700: Request processed in 47997us (48230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.130297:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788664147.130459:0:9894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e4000 x1875550140413440/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788664163 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664147.130475:0:9894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875550140413440:0@lo:700: 00000004:00080000:3.0:1788664147.132421:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788664147.135959:0:8428:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788664147.135967:0:8428:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788664147.136074:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c435358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9900:x1875550140415616:12345-0@lo:7: Request processed in 11129us (14340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664147.136086:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788664147.136136:0:9900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c435358a80 x1875550140415616/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788664163 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664147.136157:0:9900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c435358a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9900:1875550140415616:0@lo:7: 00000004:00080000:1.0:1788664147.136172:0:9900:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788664147.136204:0:9900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c435358a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9900:1875550140415744:0@lo:5: 00000100:00100000:1.0:1788664147.136339:0:9900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.136364:0:9900:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43518f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664147.136414:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140415744 00000100:00100000:0.0:1788664147.136420:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140415744 00000100:00100000:0.0:1788664147.136460:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664147.136469:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9900:x1875550140415744:12345-0@lo:5: 00002000:00080000:0.0:1788664147.136491:0:8426:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788664147.136495:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788664147.136761:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9900:x1875550140415744:12345-0@lo:5: Request processed in 293us (422us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788664147.136831:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788664147.139716:0:9900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c435358a80 x1875550140415744/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788664163 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664147.139737:0:9900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c435358a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9900:1875550140415744:0@lo:5: 00000004:00080000:2.0:1788664147.139753:0:9900:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788664147.139822:0:9900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9900:1875550140415872:0@lo:700: 00000100:00100000:2.0:1788664147.139885:0:9900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664147.139914:0:9900:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42b9336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.140699:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140415872 00000100:00100000:3.0:1788664147.140707:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140415872 00000100:00100000:3.0:1788664147.140753:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788664147.140762:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9900:x1875550140415872:12345-0@lo:700: 00000100:00100000:1.0:1788664147.143665:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664147.143692:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c435358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140416000:0@lo:13: 00000100:00100000:1.0:1788664147.143760:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788664147.143827:0:9894:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788664147.143850:0:9894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43535bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875550140416128:0@lo:7: 00000100:00100000:1.0:1788664147.143883:0:9894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.143908:0:9894:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43518fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.143994:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140416000 00000100:00100000:3.0:1788664147.144001:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140416000 00000100:00100000:0.0:1788664147.144054:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140416128 00000100:00100000:3.0:1788664147.144057:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664147.144061:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140416128 00000100:00100000:3.0:1788664147.144069:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1875550140416000:12345-0@lo:13: 00000100:00100000:0.0:1788664147.144106:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00002000:00000024:3.0:1788664147.144115:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1788664147.144130:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9894:x1875550140416128:12345-0@lo:7: 00000100:00100000:3.0:1788664147.144168:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1875550140416000:12345-0@lo:13: Request processed in 101us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.144177:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788664147.145342:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c435358380 x1875550140416000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664147.145365:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c435358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140416000:0@lo:13: 00000001:00080000:2.0:1788664147.150812:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1788664147.151282:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9900:x1875550140415872:12345-0@lo:700: Request processed in 10516us (11391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.151294:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788664147.151350:0:9900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b46300 x1875550140415872/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788664163 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664147.151374:0:9900:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788664147.151391:0:9900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9900:1875550140415872:0@lo:700: 00002000:00080000:1.0:1788664147.156964:0:9895:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788664147.156972:0:9895:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788664147.157063:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9894:x1875550140416128:12345-0@lo:7: Request processed in 12945us (13174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664147.157084:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788664147.158094:0:9894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43535bb80 x1875550140416128/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788664163 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664147.158112:0:9894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43535bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875550140416128:0@lo:7: 00000004:00080000:0.0:1788664147.158134:0:9894:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788664147.158187:0:9894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875550140416256:0@lo:5: 00000100:00100000:0.0:1788664147.159360:0:9894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.159403:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140416256 00000100:00100000:0.0:1788664147.159411:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140416256 00000100:00100000:0.0:1788664147.159471:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664147.159480:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9894:x1875550140416256:12345-0@lo:5: 00002000:00080000:0.0:1788664147.159509:0:8426:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788664147.159548:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9894:x1875550140416256:12345-0@lo:5: Request processed in 70us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664147.159554:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664147.159588:0:9894:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4780 going to sleep for 11 seconds 00010000:00080000:0.0:1788664147.159605:0:9894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e5180 x1875550140416256/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788664163 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664147.159617:0:9894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875550140416256:0@lo:5: 00000004:00080000:0.0:1788664147.159637:0:9894:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788664147.159668:0:9894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875550140416384:0@lo:5: 00000100:00100000:0.0:1788664147.159693:0:9894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664147.159719:0:9894:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.160519:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140416384 00000100:00100000:3.0:1788664147.160528:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140416384 00000100:00100000:3.0:1788664147.160570:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788664147.160578:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9894:x1875550140416384:12345-0@lo:5: 00002000:00080000:3.0:1788664147.160609:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000004:02000040:2.0:1788664147.163341:0:9900:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1788664147.164123:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9894:x1875550140416384:12345-0@lo:5: Request processed in 3541us (4424us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788664147.164140:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788664147.165862:0:9894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e5180 x1875550140416384/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788664163 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664147.165894:0:9894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875550140416384:0@lo:5: 00000004:00080000:1.0:1788664147.165910:0:9894:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788664147.165956:0:9894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303704380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9894:1875550140416512:0@lo:900: 00000100:00100000:1.0:1788664147.166010:0:9894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664147.166041:0:9894:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43518f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664147.166865:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140416512 00000100:00100000:3.0:1788664147.166897:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140416512 00000100:00100000:3.0:1788664147.166976:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788664147.166986:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9894:x1875550140416512:12345-0@lo:900: 00000100:00100000:3.0:1788664147.167055:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9894:x1875550140416512:12345-0@lo:900: Request processed in 70us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664147.167063:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788664147.173448:0:9894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303704380 x1875550140416512/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788664163 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664147.173479:0:9894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303704380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9894:1875550140416512:0@lo:900: 00000100:00100000:2.0:1788664147.173683:0:9900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9900:1875550140416640:0@lo:5: 00000100:00100000:2.0:1788664147.173747:0:9900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664147.173819:0:9900:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42b9336c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664147.174384:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140416640 00000100:00100000:1.0:1788664147.174391:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140416640 00000100:00100000:1.0:1788664147.174439:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788664147.174448:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9900:x1875550140416640:12345-0@lo:5: 00002000:00080000:2.0:1788664147.193010:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788664147.193031:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1788664147.199012:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9900:x1875550140416640:12345-0@lo:5: Request processed in 24559us (25258us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788664147.199025:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788664147.199258:0:9900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b46300 x1875550140416640/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788664163 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664147.199277:0:9900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9900:1875550140416640:0@lo:5: 00000004:00080000:2.0:1788664147.199294:0:9900:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:1.0:1788664147.389906:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788664147.710217:0:9931:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788664147.710451:0:9931:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788664148.036087:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664148.036110:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140416768:0@lo:41: 00000100:00100000:2.0:1788664148.036192:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664148.036254:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140416768 00000100:00100000:2.0:1788664148.036261:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140416768 00000100:00100000:2.0:1788664148.036309:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788664148.036318:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140416768:12345-0@lo:41: 00000004:00000024:2.0:1788664148.036355:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788664148.036401:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140416768:12345-0@lo:41: Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664148.036408:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788664148.036468:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140416768:0@lo:41: 00010000:00010000:3.0:1788664148.419459:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664148.548848:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664148.548884:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140416896:0@lo:13: 00000100:00100000:0.0:1788664148.548949:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664148.549010:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140416896 00000100:00100000:0.0:1788664148.549017:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140416896 00000100:00100000:0.0:1788664148.549055:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664148.549063:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140416896:12345-0@lo:13: 00002000:00000024:0.0:1788664148.549092:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664148.549135:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140416896:12345-0@lo:13: Request processed in 72us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664148.549142:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788664148.549190:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e7480 x1875550140416896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664148.549223:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140416896:0@lo:13: 00000100:00100000:1.0:1788664148.564557:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664148.564581:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140417024:0@lo:13: 00000100:00100000:1.0:1788664148.564664:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664148.564722:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140417024 00000100:00100000:1.0:1788664148.564729:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140417024 00000100:00100000:1.0:1788664148.564792:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788664148.564802:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140417024:12345-0@lo:13: 00002000:00000024:1.0:1788664148.564822:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664148.564875:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140417024:12345-0@lo:13: Request processed in 62us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664148.564891:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788664148.564930:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303704380 x1875550140417024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664148.564947:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140417024:0@lo:13: 00000001:00080000:0.0:1788664148.717130:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1788664148.717152:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1788664149.438082:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664150.464690:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788664150.666470:0:10032:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788664150.666727:0:10032:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788664151.487253:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664151.626094:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788664151.626117:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140417152:0@lo:41: 00000100:00100000:0.0:1788664151.626178:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664151.626237:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140417152 00000100:00100000:1.0:1788664151.626247:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140417152 00000100:00100000:1.0:1788664151.626325:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788664151.626335:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140417152:12345-0@lo:41: 00000004:00000024:1.0:1788664151.626368:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788664151.626432:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140417152:12345-0@lo:41: Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664151.626439:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788664151.628880:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140417152:0@lo:41: 00000020:00000004:3.0:1788664151.714968:0:10080:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788664151.714977:0:10080:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1788664152.126885:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140417280:0@lo:400: 00000100:00100000:1.0:1788664152.126965:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664152.126977:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140417408:0@lo:400: 00000100:00100000:3.0:1788664152.127007:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664152.127032:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140417920:0@lo:400: 00000100:00100000:1.0:1788664152.127032:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140417792:0@lo:400: 00000100:00100000:3.0:1788664152.127056:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664152.127058:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664152.127072:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140418432:0@lo:400: 00000100:00100000:1.0:1788664152.127072:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140418304:0@lo:400: 00000100:00100000:3.0:1788664152.127092:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664152.127104:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664152.127115:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788664152.127121:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140417536:0@lo:400: 00000100:00100000:1.0:1788664152.127121:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140418816:0@lo:400: 00000100:00100000:3.0:1788664152.127142:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664152.127151:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664152.127159:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140418048:0@lo:400: 00000100:00100000:1.0:1788664152.127167:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788664152.127172:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140417664:0@lo:400: 00000100:00100000:3.0:1788664152.127179:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664152.127199:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140417408 00000100:00100000:3.0:1788664152.127205:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140418560:0@lo:400: 00000100:00100000:1.0:1788664152.127210:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140417408 00000100:00100000:3.0:1788664152.127228:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664152.127244:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140417920 00000100:00100000:1.0:1788664152.127247:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140417920 00000100:00100000:3.0:1788664152.127250:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140418304 00000100:00100000:3.0:1788664152.127253:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140418304 00000100:00100000:1.0:1788664152.127265:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140418432 00000100:00100000:1.0:1788664152.127268:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140418432 00000100:00100000:3.0:1788664152.127271:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140418816 00000100:00100000:3.0:1788664152.127273:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140418816 00000100:00100000:1.0:1788664152.127279:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140418048 00000100:00100000:1.0:1788664152.127281:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140418048 00000100:00100000:3.0:1788664152.127291:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788664152.127291:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140418560 00000100:00100000:1.0:1788664152.127293:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140418560 00000100:00100000:3.0:1788664152.127298:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140418304:12345-0@lo:400: 00000100:00100000:1.0:1788664152.127304:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788664152.127308:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140417408:12345-0@lo:400: 00000100:00100000:3.0:1788664152.127342:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140418304:12345-0@lo:400: Request processed in 44us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664152.127344:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140417408:12345-0@lo:400: Request processed in 36us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664152.127350:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788664152.127350:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788664152.127365:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788664152.127366:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788664152.127372:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140418816:12345-0@lo:400: 00000100:00100000:1.0:1788664152.127372:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140417920:12345-0@lo:400: 00000100:00100000:3.0:1788664152.127396:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140418816:12345-0@lo:400: Request processed in 25us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664152.127396:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140417920:12345-0@lo:400: Request processed in 25us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664152.127402:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788664152.127402:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788664152.127412:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788664152.127418:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c435358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140418432:12345-0@lo:400: 00000100:00100000:3.0:1788664152.127420:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788664152.127425:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140418048:12345-0@lo:400: 00000100:00100000:1.0:1788664152.127442:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c435358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140418432:12345-0@lo:400: Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664152.127447:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140418048:12345-0@lo:400: Request processed in 22us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664152.127448:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788664152.127452:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788664152.127458:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788664152.127463:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140418560:12345-0@lo:400: 00000100:00100000:1.0:1788664152.127504:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140418560:12345-0@lo:400: Request processed in 40us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664152.127517:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788664152.127541:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140417792 00000100:00100000:1.0:1788664152.127545:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140417792 00000100:00100000:1.0:1788664152.127566:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140417536 00000100:00100000:1.0:1788664152.127569:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140417536 00000100:00100000:1.0:1788664152.127579:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788664152.127585:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140417792:12345-0@lo:400: 00000100:00080000:0.0:1788664152.127599:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788664152.127604:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664152.127606:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788664152.127608:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664152.127618:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664152.127626:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140417792:12345-0@lo:400: Request processed in 41us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664152.127632:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788664152.127644:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788664152.127649:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c435358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140417536:12345-0@lo:400: 00000100:00100000:1.0:1788664152.127674:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c435358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140417536:12345-0@lo:400: Request processed in 25us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664152.127691:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788664152.127705:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664152.127713:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140418944:0@lo:13: 00000100:00100000:1.0:1788664152.127727:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140417536:0@lo:400: 00000100:00100000:2.0:1788664152.127739:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788664152.127739:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f6a00 x1875550140418048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664152.127749:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140418048:0@lo:400: 00010000:00080000:1.0:1788664152.127758:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f7480 x1875550140418560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664152.127765:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140418560:0@lo:400: 00010000:00080000:1.0:1788664152.127798:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f7b80 x1875550140417408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664152.127806:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140417408:0@lo:400: 00010000:00080000:1.0:1788664152.127824:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f7100 x1875550140417920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664152.127831:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140417920:0@lo:400: 00010000:00080000:1.0:1788664152.127839:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f5f80 x1875550140418432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664152.127845:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140418432:0@lo:400: 00000100:00100000:2.0:1788664152.127858:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140417280 00000100:00100000:2.0:1788664152.127861:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140417280 00000100:00100000:2.0:1788664152.127885:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788664152.127892:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140417280:12345-0@lo:400: 00000100:00100000:1.0:1788664152.127900:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140418944 00000100:00100000:1.0:1788664152.127903:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140418944 00000100:00100000:2.0:1788664152.127921:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140417280:12345-0@lo:400: Request processed in 30us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664152.127924:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788664152.127927:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788664152.127929:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140418944:12345-0@lo:13: 00002000:00000024:1.0:1788664152.127947:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664152.128469:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140418944:12345-0@lo:13: Request processed in 536us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664152.128477:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788664152.130929:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140418176:0@lo:400: 00000100:00100000:0.0:1788664152.130997:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664152.131021:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140418688:0@lo:400: 00000100:00100000:0.0:1788664152.131064:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664152.131102:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140417280:0@lo:400: 00000100:00100000:0.0:1788664152.131117:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140417792:0@lo:400: 00010000:00080000:0.0:1788664152.131131:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f6d80 x1875550140418304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664152.131141:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140418304:0@lo:400: 00010000:00080000:0.0:1788664152.131157:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f7800 x1875550140418816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664152.131164:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788664152.131186:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140418816:0@lo:400: 00000100:00100000:2.0:1788664152.133107:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140418176 00000100:00100000:2.0:1788664152.133120:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140418176 00000100:00100000:2.0:1788664152.133186:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140418688 00000100:00100000:2.0:1788664152.133190:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140418688 00000100:00100000:2.0:1788664152.133208:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788664152.133216:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140418176:12345-0@lo:400: 00000100:00100000:2.0:1788664152.133301:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140418176:12345-0@lo:400: Request processed in 85us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664152.133308:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788664152.133323:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788664152.133329:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140418688:12345-0@lo:400: 00000100:00100000:2.0:1788664152.133360:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140418688:12345-0@lo:400: Request processed in 31us (2296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664152.133365:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788664152.133424:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b44000 x1875550140418944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664152.133445:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140418944:0@lo:13: 00010000:00080000:2.0:1788664152.133498:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f4e00 x1875550140418176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664152.133507:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140418176:0@lo:400: 00010000:00080000:2.0:1788664152.133523:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f5c00 x1875550140418688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664152.133531:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788664152.133542:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140418688:0@lo:400: 00000100:00080000:2.0:1788664152.133581:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664152.133585:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664152.134389:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140417664 00000100:00100000:3.0:1788664152.134398:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140417664 00000100:00100000:3.0:1788664152.134438:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788664152.134446:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140417664:12345-0@lo:400: 00000100:00100000:3.0:1788664152.134518:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140417664:12345-0@lo:400: Request processed in 74us (6899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664152.134535:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788664152.134576:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f4700 x1875550140417664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664152.134586:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140417664:0@lo:400: 00010000:00010000:2.0:1788664152.510017:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664152.639120:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664152.639147:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140419072:0@lo:13: 00000100:00100000:3.0:1788664152.639253:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664152.639487:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140419072 00000100:00100000:1.0:1788664152.639496:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140419072 00000100:00100000:1.0:1788664152.639551:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788664152.639561:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140419072:12345-0@lo:13: 00002000:00000024:1.0:1788664152.639585:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664152.639651:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140419072:12345-0@lo:13: Request processed in 92us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664152.639659:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788664152.640150:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303707800 x1875550140419072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664152.640173:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140419072:0@lo:13: 00000100:00100000:0.0:1788664153.151174:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140419200:0@lo:41: 00000100:00100000:0.0:1788664153.151242:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664153.151711:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140419200 00000100:00100000:1.0:1788664153.151720:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140419200 00000100:00100000:1.0:1788664153.151831:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788664153.151842:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140419200:12345-0@lo:41: 00000004:00000024:1.0:1788664153.151890:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788664153.151946:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140419200:12345-0@lo:41: Request processed in 107us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664153.151955:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788664153.152027:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140419200:0@lo:41: 00000100:00100000:0.0:1788664153.437806:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664153.437975:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119395712 00000100:00100000:2.0:1788664153.437985:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119395712 00000100:00100000:2.0:1788664153.438042:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 181 00000100:00100000:2.0:1788664153.438051:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2389:x1875550119395712:12345-192.168.203.52@tcp:250: 00010000:00080000:2.0:1788664153.438088:0:6505:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2e13f63f-6cb4-4650-b0b3-d6df6f89c262@192.168.203.52@tcp t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:2.0:1788664153.438117:0:6505:0:(genops.c:1385:class_connect()) connect: client 2e13f63f-6cb4-4650-b0b3-d6df6f89c262, cookie 0xcd11f61c1413d6f4 00000100:00080000:2.0:1788664153.438249:0:6505:0:(import.c:65:import_set_state_nolock()) ffff93c303735800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664153.438323:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+5:2389:x1875550119395712:12345-192.168.203.52@tcp:250: Request processed in 271us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664153.438331:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 181 00000100:00100000:0.0:1788664153.457234:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664153.457505:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119395584 00000100:00100000:2.0:1788664153.457514:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119395584 00000100:00100000:2.0:1788664153.457625:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 182 00000100:00100000:2.0:1788664153.457649:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+5:6149:x1875550119395584:12345-192.168.203.52@tcp:101: 00010000:00010000:2.0:1788664153.457666:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664153.457680:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d6fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d11f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664153.457708:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d11f expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664153.457719:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d11f expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664153.457728:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0ca00, rc 0) 00000100:00100000:2.0:1788664153.457814:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+6:6149:x1875550119395584:12345-192.168.203.52@tcp:101: Request processed in 168us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664153.457822:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 182 00000100:00100000:1.0:1788664153.463603:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664153.488435:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119395840 00000100:00100000:0.0:1788664153.488449:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119395840 00000100:00100000:0.0:1788664153.488520:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 183 00000100:00100000:0.0:1788664153.488530:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+6:6149:x1875550119395840:12345-192.168.203.52@tcp:501: 00000100:00100000:0.0:1788664153.488684:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+6:6149:x1875550119395840:12345-192.168.203.52@tcp:501: Request processed in 154us (25103us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788664153.488692:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 183 00000100:00100000:1.0:1788664153.496198:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664153.496457:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119395968 00000100:00100000:0.0:1788664153.496467:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119395968 00000100:00100000:0.0:1788664153.496522:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:0.0:1788664153.496533:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+6:6149:x1875550119395968:12345-192.168.203.52@tcp:101: 00010000:00010000:0.0:1788664153.496549:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664153.496568:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40153be00/0xcd11f61c1413d702 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d126 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664153.496608:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40153be00/0xcd11f61c1413d702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d126 expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664153.496620:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40153be00/0xcd11f61c1413d702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d126 expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664153.496648:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40153be00, rc 0) 00000100:00100000:0.0:1788664153.496707:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+7:6149:x1875550119395968:12345-192.168.203.52@tcp:101: Request processed in 175us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664153.496714:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:1.0:1788664153.502033:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664153.502148:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119396096 00000100:00100000:3.0:1788664153.502158:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119396096 00000100:00100000:3.0:1788664153.502214:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:3.0:1788664153.502224:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+7:6149:x1875550119396096:12345-192.168.203.52@tcp:501: 00000100:00100000:3.0:1788664153.502381:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+8:6149:x1875550119396096:12345-192.168.203.52@tcp:501: Request processed in 158us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664153.502388:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:1.0:1788664153.513647:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664153.513728:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119396224 00000100:00100000:2.0:1788664153.513736:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119396224 00000100:00100000:0.0:1788664153.513939:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 186 00000100:00100000:0.0:1788664153.513954:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+8:6149:x1875550119396224:12345-192.168.203.52@tcp:503: 00000100:00100000:0.0:1788664153.514115:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+8:6149:x1875550119396224:12345-192.168.203.52@tcp:503: Request processed in 165us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664153.514123:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 186 00000100:00100000:1.0:1788664153.526860:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664153.530552:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119396352 00000100:00100000:3.0:1788664153.530567:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119396352 00000100:00100000:2.0:1788664153.532944:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:2.0:1788664153.532960:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+8:6167:x1875550119396352:12345-192.168.203.52@tcp:502: 00000100:00100000:2.0:1788664153.533141:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+8:6167:x1875550119396352:12345-192.168.203.52@tcp:502: Request processed in 184us (6292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664153.533150:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 187 00010000:00010000:2.0:1788664153.534938:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664153.607922:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664153.608017:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119396480 00000100:00100000:2.0:1788664153.608028:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119396480 00000100:00100000:2.0:1788664153.608145:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:2.0:1788664153.608156:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+8:6167:x1875550119396480:12345-192.168.203.52@tcp:502: 00000100:00100000:2.0:1788664153.608319:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+8:6167:x1875550119396480:12345-192.168.203.52@tcp:502: Request processed in 164us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664153.608328:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:1.0:1788664153.633897:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664153.634628:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119396608 00000100:00100000:2.0:1788664153.634650:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119396608 00000100:00100000:2.0:1788664153.634712:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:2.0:1788664153.634721:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+8:6149:x1875550119396608:12345-192.168.203.52@tcp:101: 00010000:00010000:2.0:1788664153.634737:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664153.634753:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0c200/0xcd11f61c1413d709 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d157 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664153.634808:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0c200/0xcd11f61c1413d709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d157 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664153.634819:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0c200/0xcd11f61c1413d709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d157 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664153.634828:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c200, rc 0) 00000100:00100000:2.0:1788664153.634889:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:6149:x1875550119396608:12345-192.168.203.52@tcp:101: Request processed in 169us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664153.634896:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:1.0:1788664153.639128:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664153.642135:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119396736 00000100:00100000:2.0:1788664153.642150:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119396736 00000100:00100000:2.0:1788664153.642227:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:2.0:1788664153.642237:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:6149:x1875550119396736:12345-192.168.203.52@tcp:256: 20000000:01000000:2.0:1788664153.642262:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788664153.642288:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788664153.642298:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788664153.642302:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788664153.642305:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788664153.642307:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788664153.655316:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:6149:x1875550119396736:12345-192.168.203.52@tcp:256: Request processed in 13070us (16187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664153.655330:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:1.0:1788664153.663831:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664153.663862:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140419328:0@lo:13: 00000100:00100000:1.0:1788664153.663947:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664153.664338:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664153.664349:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140419456:0@lo:13: 00000100:00100000:2.0:1788664153.664380:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664153.664546:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140419328 00000100:00100000:1.0:1788664153.664553:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140419328 00000100:00100000:0.0:1788664153.664597:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140419456 00000100:00100000:0.0:1788664153.664603:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140419456 00000100:00100000:1.0:1788664153.664610:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788664153.664622:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140419328:12345-0@lo:13: 00002000:00000024:1.0:1788664153.664651:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664153.664704:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140419328:12345-0@lo:13: Request processed in 85us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664153.664711:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788664153.664727:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788664153.664733:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140419456:12345-0@lo:13: 00002000:00000024:1.0:1788664153.664742:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664153.664798:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140419456:12345-0@lo:13: Request processed in 65us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664153.664818:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788664153.664850:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f760380 x1875550140419328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664153.664872:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140419328:0@lo:13: 00000100:00100000:1.0:1788664153.665290:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00080000:2.0:1788664153.665369:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b45880 x1875550140419456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664153.665384:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140419456:0@lo:13: 00000100:00100000:0.0:1788664153.665592:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119396864 00000100:00100000:0.0:1788664153.665598:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119396864 00000100:00100000:0.0:1788664153.665758:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:0.0:1788664153.665794:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:6149:x1875550119396864:12345-192.168.203.52@tcp:101: 00010000:00010000:0.0:1788664153.665807:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664153.665825:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d710 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d15e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664153.665852:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d15e expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664153.665878:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d15e expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664153.665889:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40153b800, rc 0) 00000100:00100000:0.0:1788664153.665941:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6149:x1875550119396864:12345-192.168.203.52@tcp:101: Request processed in 174us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664153.665949:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:1.0:1788664153.671742:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664153.672181:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119396992 00000100:00100000:2.0:1788664153.672192:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119396992 00000100:00100000:2.0:1788664153.672240:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00100000:2.0:1788664153.672249:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6149:x1875550119396992:12345-192.168.203.52@tcp:501: 00000100:00100000:2.0:1788664153.672405:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6149:x1875550119396992:12345-192.168.203.52@tcp:501: Request processed in 156us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664153.672413:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00100000:1.0:1788664153.688977:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664153.689201:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119397120 00000100:00100000:2.0:1788664153.689211:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119397120 00000100:00100000:2.0:1788664153.689268:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 193 00000100:00100000:2.0:1788664153.689277:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6149:x1875550119397120:12345-192.168.203.52@tcp:503: 00000100:00100000:2.0:1788664153.689422:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6149:x1875550119397120:12345-192.168.203.52@tcp:503: Request processed in 147us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664153.689429:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 193 00000100:00100000:1.0:1788664153.695436:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664153.695527:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119397248 00000100:00100000:0.0:1788664153.695537:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119397248 00000100:00100000:0.0:1788664153.695601:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:0.0:1788664153.695610:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6174:x1875550119397248:12345-192.168.203.52@tcp:502: 00000100:00100000:0.0:1788664153.695762:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6174:x1875550119397248:12345-192.168.203.52@tcp:502: Request processed in 152us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664153.695797:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:1.0:1788664153.701991:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664153.702045:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119397376 00000100:00100000:0.0:1788664153.702056:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119397376 00000100:00100000:0.0:1788664153.702116:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:0.0:1788664153.702126:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6174:x1875550119397376:12345-192.168.203.52@tcp:502: 00000100:00100000:0.0:1788664153.702289:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6174:x1875550119397376:12345-192.168.203.52@tcp:502: Request processed in 163us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664153.702296:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:1.0:1788664153.712606:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664153.712651:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664153.712733:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119397504 00000100:00100000:3.0:1788664153.712743:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119397504 00000100:00100000:3.0:1788664153.712827:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119397760 00000100:00100000:3.0:1788664153.712838:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119397760 00000100:00100000:3.0:1788664153.712856:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1788664153.712863:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875550119397504:12345-192.168.203.52@tcp:38: 00010000:00080000:3.0:1788664153.712893:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:3.0:1788664153.712959:0:6512:0:(genops.c:1385:class_connect()) connect: client b07edea8-5696-4cd5-9a12-cefd3a8358e9, cookie 0xcd11f61c1413d717 00000004:00100000:3.0:1788664153.712984:0:6512:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788664153.713201:0:6512:0:(import.c:65:import_set_state_nolock()) ffff93c43f7c9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664153.713268:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2389:x1875550119397504:12345-192.168.203.52@tcp:38: Request processed in 404us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664153.713275:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1788664153.713293:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788664153.713297:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875550119397760:12345-192.168.203.52@tcp:38: 00010000:00080000:3.0:1788664153.713312:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:3.0:1788664153.713342:0:6512:0:(genops.c:1385:class_connect()) connect: client b07edea8-5696-4cd5-9a12-cefd3a8358e9, cookie 0xcd11f61c1413d71e 00000004:00100000:3.0:1788664153.713353:0:6512:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788664153.713477:0:6512:0:(import.c:65:import_set_state_nolock()) ffff93c302b95800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664153.713502:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2389:x1875550119397760:12345-192.168.203.52@tcp:38: Request processed in 203us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664153.713508:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00010000:00010000:3.0:1788664154.558015:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664154.734359:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664154.734438:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119398016 00000100:00100000:0.0:1788664154.734449:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119398016 00000100:00100000:0.0:1788664154.734523:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788664154.734534:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:6149:x1875550119398016:12345-192.168.203.52@tcp:41: 00000004:00000024:0.0:1788664154.734598:0:9524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788664154.734672:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:6149:x1875550119398016:12345-192.168.203.52@tcp:41: Request processed in 140us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664154.734679:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00080000:2.0:1788664154.734980:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664154.739593:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664154.739637:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664154.739746:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119397888 00000100:00100000:1.0:1788664154.739756:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119397888 00000100:00100000:1.0:1788664154.739850:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119397632 00000100:00100000:1.0:1788664154.739853:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119397632 00000100:00100000:1.0:1788664154.739875:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1788664154.739884:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:0:x1875550119397888:12345-192.168.203.52@tcp:41: 00000004:00000024:1.0:1788664154.739919:0:9169:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788664154.739976:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:0:x1875550119397888:12345-192.168.203.52@tcp:41: Request processed in 93us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664154.739984:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1788664154.739999:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1788664154.740006:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:0:x1875550119397632:12345-192.168.203.52@tcp:41: 00000004:00000024:1.0:1788664154.740017:0:9169:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788664154.740039:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:0:x1875550119397632:12345-192.168.203.52@tcp:41: Request processed in 34us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664154.740046:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00080000:0.0:1788664154.745215:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788664154.747167:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664154.747266:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119398144 00000100:00100000:3.0:1788664154.747276:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119398144 00000100:00100000:3.0:1788664154.747332:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1788664154.747343:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:6149:x1875550119398144:12345-192.168.203.52@tcp:40: 00000100:00100000:3.0:1788664154.747434:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:6149:x1875550119398144:12345-192.168.203.52@tcp:40: Request processed in 93us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664154.747443:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1788664154.749514:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664154.749604:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119398272 00000100:00100000:2.0:1788664154.749614:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119398272 00000100:00100000:2.0:1788664154.749662:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788664154.749670:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1875550119398272:12345-192.168.203.52@tcp:8: 00010000:00080000:2.0:1788664154.749702:0:8426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:2.0:1788664154.749736:0:8426:0:(genops.c:1385:class_connect()) connect: client b07edea8-5696-4cd5-9a12-cefd3a8358e9, cookie 0xcd11f61c1413d725 00002000:00100000:2.0:1788664154.749749:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b07edea8-5696-4cd5-9a12-cefd3a8358e9/ffff93c303734800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788664154.749761:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788664154.750012:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788664154.750043:0:8426:0:(import.c:65:import_set_state_nolock()) ffff93c303733000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664154.750112:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2389:x1875550119398272:12345-192.168.203.52@tcp:8: Request processed in 441us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664154.750120:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1788664154.755287:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664154.755435:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119398528 00000100:00100000:2.0:1788664154.755445:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119398528 00000100:00100000:2.0:1788664154.755502:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:2.0:1788664154.755514:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2393:x1875550119398528:12345-192.168.203.52@tcp:400: 00000100:00100000:2.0:1788664154.755597:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2393:x1875550119398528:12345-192.168.203.52@tcp:400: Request processed in 86us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664154.755605:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:1.0:1788664154.756347:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664154.756494:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119398400 00000100:00100000:2.0:1788664154.756501:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119398400 00000100:00100000:2.0:1788664154.756539:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:2.0:1788664154.756545:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1875550119398400:12345-192.168.203.52@tcp:8: 00010000:00080000:2.0:1788664154.756587:0:8429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:2.0:1788664154.756634:0:8429:0:(genops.c:1385:class_connect()) connect: client b07edea8-5696-4cd5-9a12-cefd3a8358e9, cookie 0xcd11f61c1413d72c 00002000:00100000:2.0:1788664154.756647:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b07edea8-5696-4cd5-9a12-cefd3a8358e9/ffff93c303737000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788664154.756665:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788664154.756888:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788664154.756919:0:8429:0:(import.c:65:import_set_state_nolock()) ffff93c303732000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664154.756968:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2389:x1875550119398400:12345-192.168.203.52@tcp:8: Request processed in 420us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664154.756976:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788664154.767283:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664154.767321:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119398656 00000100:00100000:3.0:1788664154.767336:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119398656 00000100:00100000:3.0:1788664154.767389:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1788664154.767398:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:6149:x1875550119398656:12345-192.168.203.52@tcp:900: 00000100:00100000:3.0:1788664154.767483:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:6149:x1875550119398656:12345-192.168.203.52@tcp:900: Request processed in 84us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664154.767492:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1788664154.769866:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664154.769991:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119398784 00000100:00100000:3.0:1788664154.770000:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119398784 00000100:00100000:3.0:1788664154.770053:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1788664154.770065:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:6149:x1875550119398784:12345-192.168.203.52@tcp:33: 00000004:00080000:0.0:1788664154.819604:0:6514:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 49452us 00000004:00200000:0.0:1788664154.840011:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788664154.840138:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:6149:x1875550119398784:12345-192.168.203.52@tcp:33: Request processed in 70070us (70273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664154.840154:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1788664155.136463:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664155.136585:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119398912 00000100:00100000:3.0:1788664155.136596:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119398912 00000100:00100000:3.0:1788664155.136935:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1788664155.136947:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:6192:x1875550119398912:12345-192.168.203.52@tcp:101: 00010000:00010000:3.0:1788664155.136967:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664155.137036:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413d733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d18f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664155.137215:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee400/0xcd11f61c1413d73a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664155.137230:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee400/0xcd11f61c1413d73a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664155.137245:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee400/0xcd11f61c1413d73a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664155.137287:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788664155.137304:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788664155.137323:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee400/0xcd11f61c1413d73a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664155.137350:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413d733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d18f expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664155.137368:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee400/0xcd11f61c1413d73a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d18f expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664155.137377:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c435166100) 00010000:00010000:3.0:1788664155.137380:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788664155.137384:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351ee400, rc 0) 00000100:00100000:3.0:1788664155.137458:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:6192:x1875550119398912:12345-192.168.203.52@tcp:101: Request processed in 513us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664155.137465:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00010000:00010000:2.0:1788664155.583313:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664156.610622:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664156.735162:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664156.735194:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140419584:0@lo:41: 00000100:00100000:3.0:1788664156.735276:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664156.735433:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140419584 00000100:00100000:1.0:1788664156.735441:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140419584 00000100:00100000:1.0:1788664156.735496:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788664156.735506:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140419584:12345-0@lo:41: 00000004:00000024:1.0:1788664156.735541:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788664156.735604:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140419584:12345-0@lo:41: Request processed in 100us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664156.735611:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788664156.735823:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140419584:0@lo:41: 00000100:00100000:0.0:1788664157.246116:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140419712:0@lo:13: 00000100:00100000:0.0:1788664157.246189:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664157.246404:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140419712 00000100:00100000:2.0:1788664157.246412:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140419712 00000100:00100000:2.0:1788664157.246467:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788664157.246476:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140419712:12345-0@lo:13: 00002000:00000024:2.0:1788664157.246502:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664157.246548:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140419712:12345-0@lo:13: Request processed in 74us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664157.246567:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788664157.246604:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b46680 x1875550140419712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664157.246621:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140419712:0@lo:13: 00000100:00080000:0.0:1788664157.246915:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664157.251165:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140419840:0@lo:400: 00000100:00100000:2.0:1788664157.251185:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140420096:0@lo:400: 00000100:00100000:1.0:1788664157.251284:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140419968:0@lo:400: 00000100:00100000:0.0:1788664157.251330:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140420224:0@lo:400: 00000100:00100000:2.0:1788664157.257935:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664157.258012:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140420608:0@lo:400: 00000100:00100000:2.0:1788664157.258111:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664157.258146:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140421120:0@lo:400: 00000100:00100000:2.0:1788664157.258169:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664157.258243:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140420608 00000100:00100000:2.0:1788664157.258252:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140420608 00000100:00100000:2.0:1788664157.258307:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140421120 00000100:00100000:2.0:1788664157.258310:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140421120 00000100:00100000:2.0:1788664157.258335:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788664157.258344:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140420608:12345-0@lo:400: 00000100:00100000:2.0:1788664157.258399:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140420608:12345-0@lo:400: Request processed in 56us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664157.258406:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788664157.258423:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788664157.258429:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140421120:12345-0@lo:400: 00000100:00100000:2.0:1788664157.258477:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140421120:12345-0@lo:400: Request processed in 47us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664157.258483:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788664157.258505:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788664157.258532:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b46a00 x1875550140420608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664157.258546:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140420608:0@lo:400: 00010000:00080000:2.0:1788664157.258570:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b44a80 x1875550140421120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664157.258579:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140421120:0@lo:400: 00000100:00100000:2.0:1788664157.258619:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140420096 00000100:00100000:2.0:1788664157.258623:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140420096 00000100:00100000:2.0:1788664157.258668:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788664157.258674:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140420096:12345-0@lo:400: 00000100:00100000:2.0:1788664157.258708:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140420096:12345-0@lo:400: Request processed in 35us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664157.258714:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788664157.258742:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140420096:0@lo:400: 00000100:00100000:3.0:1788664157.261018:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664157.261096:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140420352:0@lo:400: 00000100:00100000:3.0:1788664157.261287:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664157.261331:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140420864:0@lo:400: 00000100:00100000:3.0:1788664157.261357:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664157.261412:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140420352 00000100:00100000:3.0:1788664157.261432:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140420352 00000100:00100000:3.0:1788664157.261473:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788664157.261482:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140420352:12345-0@lo:400: 00000100:00100000:3.0:1788664157.261537:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140420352:12345-0@lo:400: Request processed in 56us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664157.261544:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788664157.261593:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140420352:0@lo:400: 00000100:00100000:2.0:1788664157.263232:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140419840 00000100:00100000:2.0:1788664157.263246:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140419840 00000100:00100000:2.0:1788664157.263302:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788664157.263312:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140419840:12345-0@lo:400: 00000100:00100000:2.0:1788664157.263391:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140419840:12345-0@lo:400: Request processed in 81us (2379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664157.263398:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788664157.263436:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140420864 00000100:00100000:2.0:1788664157.263440:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140420864 00000100:00100000:2.0:1788664157.263476:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788664157.263482:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140420864:12345-0@lo:400: 00000100:00100000:2.0:1788664157.263517:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140420864:12345-0@lo:400: Request processed in 36us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664157.263523:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788664157.263545:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788664157.264704:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b46300 x1875550140420864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664157.264725:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140420864:0@lo:400: 00000100:00100000:3.0:1788664157.264737:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140419840:0@lo:400: 00000100:00100000:1.0:1788664157.266413:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664157.266537:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140420480:0@lo:400: 00000100:00100000:1.0:1788664157.266580:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664157.273138:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140420992:0@lo:400: 00000100:00100000:1.0:1788664157.273204:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664157.277997:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140419968 00000100:00100000:3.0:1788664157.278013:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140419968 00000100:00100000:3.0:1788664157.278094:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140420480 00000100:00100000:3.0:1788664157.278097:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140420480 00000100:00100000:3.0:1788664157.278138:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788664157.278148:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140419968:12345-0@lo:400: 00000100:00100000:3.0:1788664157.278239:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140419968:12345-0@lo:400: Request processed in 92us (11832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664157.278246:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788664157.278262:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788664157.278269:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140420480:12345-0@lo:400: 00000100:00100000:3.0:1788664157.278299:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140420480:12345-0@lo:400: Request processed in 31us (11719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664157.278305:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1788664157.278342:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664157.279301:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140419968:0@lo:400: 00000100:00100000:1.0:1788664157.279317:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140420480:0@lo:400: 00000100:00100000:0.0:1788664157.279391:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140420992 00000100:00100000:0.0:1788664157.279396:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140420992 00000100:00100000:0.0:1788664157.279451:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788664157.279459:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140420992:12345-0@lo:400: 00000100:00100000:0.0:1788664157.279509:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140420992:12345-0@lo:400: Request processed in 50us (6305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664157.279516:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788664157.279597:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664157.279633:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140420736:0@lo:400: 00000100:00100000:3.0:1788664157.279677:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664157.279697:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140421248:0@lo:400: 00000100:00100000:3.0:1788664157.279719:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664157.279755:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140420736 00000100:00100000:3.0:1788664157.279758:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140420736 00000100:00100000:0.0:1788664157.280021:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140421248 00000100:00100000:0.0:1788664157.280026:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140421248 00000100:00100000:0.0:1788664157.280056:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788664157.280075:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140421248:12345-0@lo:400: 00000100:00100000:0.0:1788664157.280116:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140421248:12345-0@lo:400: Request processed in 42us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664157.280123:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788664157.280141:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140420224 00000100:00100000:0.0:1788664157.280146:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140420224 00000100:00100000:0.0:1788664157.280166:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788664157.280172:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140420224:12345-0@lo:400: 00000100:00100000:0.0:1788664157.280200:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140420224:12345-0@lo:400: Request processed in 28us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664157.280205:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788664157.280237:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140420224:0@lo:400: 00010000:00080000:0.0:1788664157.280251:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e5180 x1875550140421248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664157.280261:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140421248:0@lo:400: 00000100:00100000:3.0:1788664157.280338:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788664157.280345:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140420736:12345-0@lo:400: 00000100:00100000:3.0:1788664157.280379:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140420736:12345-0@lo:400: Request processed in 35us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664157.280385:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788664157.280448:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b44000 x1875550140420736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664157.280457:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140420736:0@lo:400: 00000100:00080000:1.0:1788664157.281032:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664157.281036:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788664157.281038:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664157.281063:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140420992:0@lo:400: 00010000:00010000:3.0:1788664157.637330:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664157.667317:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664157.667477:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119399040 00000100:00100000:1.0:1788664157.667489:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119399040 00000100:00100000:1.0:1788664157.667577:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:1.0:1788664157.667602:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:6245:x1875550119399040:12345-192.168.203.52@tcp:41: 00000004:00000024:1.0:1788664157.667641:0:9524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:3.0:1788664157.667758:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664157.667925:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:6245:x1875550119399040:12345-192.168.203.52@tcp:41: Request processed in 323us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664157.667933:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1788664157.690928:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664157.690960:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119399168 00000100:00100000:0.0:1788664157.690970:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119399168 00000100:00100000:0.0:1788664157.691039:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:0.0:1788664157.691049:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:6245:x1875550119399168:12345-192.168.203.52@tcp:41: 00000100:00080000:2.0:1788664157.691062:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:0.0:1788664157.691090:0:9169:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788664157.691167:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:6245:x1875550119399168:12345-192.168.203.52@tcp:41: Request processed in 119us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664157.691188:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1788664157.697665:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664157.697759:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119399296 00000100:00100000:0.0:1788664157.697880:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119399296 00000100:00100000:0.0:1788664157.697996:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1788664157.698007:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:6245:x1875550119399296:12345-192.168.203.52@tcp:13: 00002000:00000024:0.0:1788664157.698040:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664157.698227:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:6245:x1875550119399296:12345-192.168.203.52@tcp:13: Request processed in 220us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664157.698235:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1788664157.702000:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664157.702099:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119399424 00000100:00100000:1.0:1788664157.702119:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119399424 00000100:00080000:2.0:1788664157.702223:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664157.702228:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664157.707428:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:1.0:1788664157.707450:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:6245:x1875550119399424:12345-192.168.203.52@tcp:13: 00002000:00000024:1.0:1788664157.707478:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664157.707550:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:6245:x1875550119399424:12345-192.168.203.52@tcp:13: Request processed in 111us (5558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664157.707567:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1788664157.759043:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000001:00100000:0.0:1788664157.761525:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000100:00100000:2.0:1788664157.763295:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140421376:0@lo:13: 00000100:00100000:2.0:1788664157.763758:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664157.768222:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140421376 00000100:00100000:0.0:1788664157.768237:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140421376 00000100:00100000:0.0:1788664157.768366:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788664157.768377:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140421376:12345-0@lo:13: 00002000:00000024:0.0:1788664157.768404:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664157.768863:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140421376:12345-0@lo:13: Request processed in 487us (5105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664157.768871:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788664157.768955:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f7100 x1875550140421376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664157.769960:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140421376:0@lo:13: 00000100:00100000:2.0:1788664158.273005:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664158.273032:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140421504:0@lo:41: 00000100:00100000:2.0:1788664158.273104:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664158.273172:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140421504 00000100:00100000:2.0:1788664158.273179:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140421504 00000100:00100000:2.0:1788664158.273226:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788664158.273235:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140421504:12345-0@lo:41: 00000004:00000024:2.0:1788664158.273275:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788664158.273317:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140421504:12345-0@lo:41: Request processed in 84us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664158.273325:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788664158.273995:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140421504:0@lo:41: 00010000:00010000:3.0:1788664158.657088:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664158.787085:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664158.787133:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140421632:0@lo:13: 00000100:00100000:0.0:1788664158.787229:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664158.787311:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140421632 00000100:00100000:0.0:1788664158.787321:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140421632 00000100:00100000:0.0:1788664158.787377:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788664158.787387:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140421632:12345-0@lo:13: 00002000:00000024:0.0:1788664158.787428:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664158.787481:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140421632:12345-0@lo:13: Request processed in 94us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664158.787488:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788664158.787540:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f761880 x1875550140421632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664158.787571:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140421632:0@lo:13: 00000100:00100000:3.0:1788664158.794333:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664158.794373:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140421760:0@lo:13: 00000100:00100000:3.0:1788664158.794471:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664158.794556:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140421760 00000100:00100000:3.0:1788664158.794565:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140421760 00000100:00100000:3.0:1788664158.794621:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788664158.794630:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140421760:12345-0@lo:13: 00002000:00000024:3.0:1788664158.794680:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664158.794732:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140421760:12345-0@lo:13: Request processed in 102us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664158.794740:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788664158.796271:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f780000 x1875550140421760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664158.796321:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140421760:0@lo:13: 00010000:00010000:2.0:1788664159.681080:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788664159.809062:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000001:00100000:3.0:1788664159.810025:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000100:00100000:3.0:1788664159.895609:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664159.895886:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664159.895914:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664159.895940:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664159.896040:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119399936 00000100:00100000:3.0:1788664159.896049:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119399936 00000100:00100000:3.0:1788664159.896119:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788664159.896132:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119399936:12345-192.168.203.52@tcp:400: 00000100:00100000:3.0:1788664159.896208:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119399936:12345-192.168.203.52@tcp:400: Request processed in 79us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664159.896217:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788664159.896241:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119399680 00000100:00100000:3.0:1788664159.896244:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119399680 00000100:00100000:3.0:1788664159.896270:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119399808 00000100:00100000:3.0:1788664159.896292:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119399808 00000100:00100000:3.0:1788664159.896320:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:3.0:1788664159.896328:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119399680:12345-192.168.203.52@tcp:400: 00000100:00100000:3.0:1788664159.896358:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119399680:12345-192.168.203.52@tcp:400: Request processed in 31us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664159.896364:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:3.0:1788664159.896378:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:3.0:1788664159.896384:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119399808:12345-192.168.203.52@tcp:400: 00000100:00100000:3.0:1788664159.896416:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119399808:12345-192.168.203.52@tcp:400: Request processed in 32us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664159.896423:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00080000:2.0:1788664159.899973:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788664159.899990:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664159.899993:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664159.900352:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664159.900476:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119400064 00000100:00100000:3.0:1788664159.900487:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119400064 00000100:00100000:3.0:1788664159.900689:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788664159.900709:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119400064:12345-192.168.203.52@tcp:400: 00000100:00100000:3.0:1788664159.900823:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119400064:12345-192.168.203.52@tcp:400: Request processed in 118us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664159.900848:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1788664159.902864:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119399552 00000100:00100000:0.0:1788664159.902877:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119399552 00000100:00100000:0.0:1788664159.902934:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 198 00000100:00100000:0.0:1788664159.902944:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2392:x1875550119399552:12345-192.168.203.52@tcp:400: 00000100:00100000:0.0:1788664159.903016:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2392:x1875550119399552:12345-192.168.203.52@tcp:400: Request processed in 73us (7415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664159.903025:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 198 00000100:00080000:2.0:1788664159.911969:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1788664160.580737:0:10179:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788664160.702980:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788664160.838028:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b07edea8-5696-4cd5-9a12-cefd3a8358e9 00010000:00010000:3.0:1788664161.725962:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664161.860469:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664161.860509:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140421888:0@lo:41: 00000100:00100000:0.0:1788664161.860592:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664161.868661:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140421888 00000100:00100000:2.0:1788664161.868675:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140421888 00000100:00100000:2.0:1788664161.868727:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788664161.868736:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140421888:12345-0@lo:41: 00000004:00000024:2.0:1788664161.869077:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788664161.869250:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140421888:12345-0@lo:41: Request processed in 514us (8657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664161.869257:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788664161.869507:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140421888:0@lo:41: 00000100:00100000:2.0:1788664162.367919:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664162.367944:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140422016:0@lo:13: 00000100:00100000:2.0:1788664162.368019:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664162.368243:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140422016 00000100:00100000:2.0:1788664162.368251:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140422016 00000100:00100000:0.0:1788664162.368374:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788664162.368385:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140422016:12345-0@lo:13: 00002000:00000024:0.0:1788664162.368414:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664162.368463:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140422016:12345-0@lo:13: Request processed in 80us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664162.368471:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788664162.368513:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b47480 x1875550140422016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664162.368549:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140422016:0@lo:13: 00000100:00100000:0.0:1788664162.368589:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664162.368598:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140422144:0@lo:400: 00000100:00100000:0.0:1788664162.368628:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664162.368652:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140422528:0@lo:400: 00000100:00100000:3.0:1788664162.368673:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140422272:0@lo:400: 00000100:00100000:0.0:1788664162.368676:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664162.368692:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140423040:0@lo:400: 00000100:00100000:3.0:1788664162.368699:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664162.368712:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664162.368715:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140422784:0@lo:400: 00000100:00100000:0.0:1788664162.368727:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140423552:0@lo:400: 00000100:00100000:3.0:1788664162.368734:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664162.368744:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664162.368747:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140423296:0@lo:400: 00000100:00100000:0.0:1788664162.368759:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788664162.368765:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664162.368765:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140422656:0@lo:400: 00000100:00100000:3.0:1788664162.368803:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788664162.368809:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140422400:0@lo:400: 00000100:00100000:3.0:1788664162.368833:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664162.368912:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140422912:0@lo:400: 00000100:00100000:3.0:1788664162.368936:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664162.368941:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664162.368950:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140423424:0@lo:400: 00000100:00100000:0.0:1788664162.368956:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140423168:0@lo:400: 00000100:00100000:3.0:1788664162.368975:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664162.368975:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664162.368995:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140422272 00000100:00100000:0.0:1788664162.368995:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140422528 00000100:00100000:3.0:1788664162.368999:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140422272 00000100:00100000:0.0:1788664162.368999:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140422528 00000100:00100000:3.0:1788664162.369019:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140422784 00000100:00100000:3.0:1788664162.369026:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140422784 00000100:00080000:2.0:1788664162.369434:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664162.369439:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664162.369450:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140422144 00000100:00100000:2.0:1788664162.369454:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140422144 00000100:00100000:2.0:1788664162.369484:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788664162.369492:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140422144:12345-0@lo:400: 00000100:00100000:2.0:1788664162.369546:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140422144:12345-0@lo:400: Request processed in 55us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664162.369553:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788664162.369584:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140423296 00000100:00100000:2.0:1788664162.369587:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140423296 00000100:00100000:1.0:1788664162.372213:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140422400 00000100:00100000:1.0:1788664162.372229:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140422400 00000100:00100000:1.0:1788664162.372286:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140422656 00000100:00100000:1.0:1788664162.372289:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140422656 00000100:00100000:1.0:1788664162.372427:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788664162.372440:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140422400:12345-0@lo:400: 00000100:00100000:1.0:1788664162.372976:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140422400:12345-0@lo:400: Request processed in 538us (4140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664162.372984:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788664162.373005:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788664162.373013:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140422656:12345-0@lo:400: 00000100:00100000:1.0:1788664162.373045:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140422656:12345-0@lo:400: Request processed in 34us (4103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664162.373068:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788664162.373093:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140423040 00000100:00100000:1.0:1788664162.373098:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140423040 00000100:00100000:1.0:1788664162.373135:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140423552 00000100:00100000:1.0:1788664162.373139:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140423552 00000100:00100000:1.0:1788664162.373153:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140423168 00000100:00100000:1.0:1788664162.373156:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140423168 00000100:00100000:1.0:1788664162.373170:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788664162.373176:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140423040:12345-0@lo:400: 00000100:00100000:1.0:1788664162.373212:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140423040:12345-0@lo:400: Request processed in 37us (4499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664162.373221:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788664162.373231:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788664162.373236:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140423552:12345-0@lo:400: 00000100:00100000:1.0:1788664162.373278:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140423552:12345-0@lo:400: Request processed in 42us (4533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664162.373575:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788664162.373917:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788664162.373930:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140423168:12345-0@lo:400: 00000100:00100000:3.0:1788664162.373974:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140423168:12345-0@lo:400: Request processed in 49us (4998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664162.373980:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788664162.374003:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140422912 00000100:00100000:3.0:1788664162.374007:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140422912 00000100:00100000:3.0:1788664162.374026:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140423424 00000100:00100000:3.0:1788664162.374028:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140423424 00000100:00100000:3.0:1788664162.374200:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788664162.374209:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140422272:12345-0@lo:400: 00000100:00100000:3.0:1788664162.374247:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140422272:12345-0@lo:400: Request processed in 39us (5546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664162.374278:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788664162.374403:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140422784:12345-0@lo:400: 00000100:00100000:0.0:1788664162.374442:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140422784:12345-0@lo:400: Request processed in 158us (5707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664162.374449:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788664162.374462:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788664162.374467:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140422912:12345-0@lo:400: 00000100:00100000:3.0:1788664162.374560:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788664162.374575:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788664162.374582:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140423424:12345-0@lo:400: 00000100:00100000:3.0:1788664162.374614:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140423424:12345-0@lo:400: Request processed in 33us (5638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664162.374619:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788664162.374628:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788664162.374633:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140422528:12345-0@lo:400: 00000100:00100000:3.0:1788664162.374655:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140422528:12345-0@lo:400: Request processed in 22us (5978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664162.374668:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788664162.374711:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140422400:0@lo:400: 00010000:00080000:3.0:1788664162.374729:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a08380 x1875550140423424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664162.374739:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140423424:0@lo:400: 00000100:00100000:3.0:1788664162.374748:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140422272:0@lo:400: 00000100:00100000:3.0:1788664162.374758:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140422784:0@lo:400: 00000100:00100000:2.0:1788664162.376704:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788664162.376721:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140423296:12345-0@lo:400: 00000100:00100000:2.0:1788664162.377648:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140423296:12345-0@lo:400: Request processed in 929us (8877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664162.377660:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1788664162.377701:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788664162.377707:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664162.377710:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664162.377719:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664162.377763:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140423296:0@lo:400: 00000100:00100000:2.0:1788664162.377827:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140422656:0@lo:400: 00010000:00080000:2.0:1788664162.377846:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a08e00 x1875550140423168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664162.377857:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140423168:0@lo:400: 00000100:00100000:2.0:1788664162.377871:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140422528:0@lo:400: 00010000:00080000:2.0:1788664162.377883:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a08a80 x1875550140423040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664162.377892:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140423040:0@lo:400: 00010000:00080000:2.0:1788664162.377904:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a0bb80 x1875550140423552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664162.377913:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140423552:0@lo:400: 00000100:00100000:2.0:1788664162.377924:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140422144:0@lo:400: 00000100:00100000:0.0:1788664162.380196:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140422912:12345-0@lo:400: Request processed in 5718us (11248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664162.380212:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1788664162.380292:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a0b800 x1875550140422912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664162.380320:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140422912:0@lo:400: 00010000:00010000:0.0:1788664162.752669:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664162.883424:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664162.886311:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140423680:0@lo:13: 00000100:00100000:3.0:1788664162.886386:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664162.890899:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140423680 00000100:00100000:0.0:1788664162.890914:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140423680 00000100:00100000:0.0:1788664162.891023:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788664162.891035:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140423680:12345-0@lo:13: 00002000:00000024:0.0:1788664162.891061:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664162.891168:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140423680:12345-0@lo:13: Request processed in 136us (4781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664162.891176:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788664162.891261:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f761c00 x1875550140423680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664162.891283:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140423680:0@lo:13: 00000100:00100000:1.0:1788664163.391541:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140423808:0@lo:41: 00000100:00100000:1.0:1788664163.391619:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664163.391691:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140423808 00000100:00100000:2.0:1788664163.391700:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140423808 00000100:00100000:2.0:1788664163.391845:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788664163.391857:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140423808:12345-0@lo:41: 00000004:00000024:2.0:1788664163.391897:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788664163.391952:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140423808:12345-0@lo:41: Request processed in 98us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664163.391961:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788664163.392008:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140423808:0@lo:41: 00010000:00010000:3.0:1788664163.774096:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664163.902940:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140423936:0@lo:13: 00000100:00100000:1.0:1788664163.903014:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664163.904370:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140423936 00000100:00100000:0.0:1788664163.904382:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140423936 00000100:00100000:0.0:1788664163.904437:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788664163.904449:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140423936:12345-0@lo:13: 00002000:00000024:0.0:1788664163.904483:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664163.904614:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140424064:0@lo:13: 00000100:00100000:2.0:1788664163.904650:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664163.905284:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140423936:12345-0@lo:13: Request processed in 837us (2268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664163.905293:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788664163.905311:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140424064 00000100:00100000:0.0:1788664163.905316:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140424064 00000100:00100000:0.0:1788664163.905336:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788664163.905343:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140424064:12345-0@lo:13: 00002000:00000024:0.0:1788664163.905356:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664163.905402:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140424064:12345-0@lo:13: Request processed in 60us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664163.905425:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788664163.907312:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b45f80 x1875550140424064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664163.907340:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140424064:0@lo:13: 00010000:00080000:1.0:1788664163.910106:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a08380 x1875550140423936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664163.910350:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140423936:0@lo:13: 00010000:00010000:3.0:1788664164.812808:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664165.030665:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664165.030716:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664165.030743:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664165.030806:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664165.030835:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664165.030875:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119400192 00000100:00100000:3.0:1788664165.030885:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119400192 00000100:00100000:3.0:1788664165.030940:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:3.0:1788664165.030951:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2393:x1875550119400192:12345-192.168.203.52@tcp:400: 00000100:00100000:3.0:1788664165.031024:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2393:x1875550119400192:12345-192.168.203.52@tcp:400: Request processed in 74us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664165.031032:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:3.0:1788664165.031087:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119400576 00000100:00100000:3.0:1788664165.031091:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119400576 00000100:00100000:3.0:1788664165.031124:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119400704 00000100:00100000:3.0:1788664165.031127:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119400704 00000100:00100000:3.0:1788664165.031150:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:3.0:1788664165.031157:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119400576:12345-192.168.203.52@tcp:400: 00000100:00100000:3.0:1788664165.031190:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119400576:12345-192.168.203.52@tcp:400: Request processed in 33us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664165.031197:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:3.0:1788664165.031208:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:3.0:1788664165.031214:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119400704:12345-192.168.203.52@tcp:400: 00000100:00100000:3.0:1788664165.031238:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119400704:12345-192.168.203.52@tcp:400: Request processed in 24us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664165.031244:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:2.0:1788664165.031924:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119400320 00000100:00100000:2.0:1788664165.031932:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119400320 00000100:00100000:2.0:1788664165.031977:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119400448 00000100:00100000:2.0:1788664165.031981:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119400448 00000100:00100000:2.0:1788664165.032007:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:2.0:1788664165.032016:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119400320:12345-192.168.203.52@tcp:400: 00000100:00100000:2.0:1788664165.032063:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119400320:12345-192.168.203.52@tcp:400: Request processed in 47us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664165.032081:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:2.0:1788664165.032096:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:2.0:1788664165.032103:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119400448:12345-192.168.203.52@tcp:400: 00000100:00100000:2.0:1788664165.032129:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119400448:12345-192.168.203.52@tcp:400: Request processed in 27us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664165.032136:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00080000:2.0:1788664165.032159:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788664165.032164:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664165.032166:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664165.032168:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788664165.172837:0:10326:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed18b0a90 20000000:00000080:2.0:1788664165.172856:0:10326:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c43f787400 uarg=0000000000000000 20000000:01000000:2.0:1788664165.172919:0:10326:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788664165.172927:0:10326:0:(mgs_llog.c:6068:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788664165.172930:0:10326:0:(mgs_llog.c:6099:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788664165.172935:0:10326:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788664165.172940:0:10326:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788664165.173000:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788664165.173002:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788664165.174270:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1788664165.174849:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1788664165.174882:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1788664165.174898:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1788664165.174909:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788664165.174911:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788664165.176534:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1788664165.176759:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1788664165.177045:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1788664165.177060:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1788664165.177281:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788664165.177284:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788664165.178498:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1788664165.179262:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1788664165.179306:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1788664165.179325:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1788664165.179338:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788664165.179340:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788664165.180862:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1788664165.181187:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1788664165.181219:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1788664165.181237:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1788664165.181247:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788664165.181249:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788664165.183709:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1788664165.184568:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1788664165.184600:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1788664165.184615:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:1.0:1788664165.184632:0:10326:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788664165.184651:0:10326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.184684:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d5d5 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.184693:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4351eee00/0xcd11f61c1413d606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d5ff expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.184699:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c402a0ce00/0xcd11f61c1413d645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d63e expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.184706:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d64c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.184712:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4351ee000/0xcd11f61c1413d661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d65a expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.184720:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4351ef400/0xcd11f61c1413d67d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d676 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.184726:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4351efa00/0xcd11f61c1413d6a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d6a0 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.184733:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d6bc expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.184739:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d6ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d6e6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.184749:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d6fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d11f expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.184956:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c40153be00/0xcd11f61c1413d702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d126 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.184964:0:10326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.185005:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c40153be00/0xcd11f61c1413d702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d126 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.185021:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c40153be00/0xcd11f61c1413d702 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d126 expref: 9 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.185036:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140424192:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664165.185363:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d11f expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.185371:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d6fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d11f expref: 9 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.185380:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140424320:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664165.185424:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d6e6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.185433:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d6ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d6e6 expref: 23 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.185441:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140424448:0@lo:104: 00000100:00100000:1.0:1788664165.185497:0:10326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664165.185557:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d6bc expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.185567:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d6bc expref: 23 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.185575:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140424576:0@lo:104: 00000100:00100000:1.0:1788664165.185599:0:10326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664165.185621:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4351efa00/0xcd11f61c1413d6a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d6a0 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.185629:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c4351efa00/0xcd11f61c1413d6a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d6a0 expref: 23 pid: 6504 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.185637:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140424704:0@lo:104: 00000100:00100000:1.0:1788664165.185660:0:10326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664165.185677:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4351ef400/0xcd11f61c1413d67d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d676 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.185686:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c4351ef400/0xcd11f61c1413d67d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d676 expref: 23 pid: 6504 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.185694:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140424832:0@lo:104: 00000100:00100000:1.0:1788664165.185717:0:10326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664165.185734:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4351ee000/0xcd11f61c1413d661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d65a expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.185743:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c4351ee000/0xcd11f61c1413d661 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d65a expref: 23 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.185752:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140424960:0@lo:104: 00010000:00010000:1.0:1788664165.185826:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d64c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.185836:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d653 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d64c expref: 23 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.185846:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140425088:0@lo:104: 00010000:00010000:1.0:1788664165.185874:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c402a0ce00/0xcd11f61c1413d645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d63e expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.185882:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c402a0ce00/0xcd11f61c1413d645 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d63e expref: 23 pid: 6504 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.185891:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140425216:0@lo:104: 00010000:00010000:1.0:1788664165.185915:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4351eee00/0xcd11f61c1413d606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d5ff expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.185923:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c4351eee00/0xcd11f61c1413d606 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d5ff expref: 23 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.185931:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303aba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140425344:0@lo:104: 00010000:00010000:1.0:1788664165.185955:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d5d5 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.185963:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d5dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d5d5 expref: 23 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.185972:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140425472:0@lo:104: 00000100:00100000:1.0:1788664165.185990:0:10326:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c30396de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664165.186896:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788664165.186929:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664165.186951:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664165.186961:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664165.186969:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664165.186977:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664165.186987:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140424448 00000100:00100000:2.0:1788664165.186995:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140424448 00000100:00100000:2.0:1788664165.187039:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140424576 00000100:00100000:2.0:1788664165.187043:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140424576 00000100:00100000:2.0:1788664165.187054:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140424704 00000100:00100000:2.0:1788664165.187056:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140424704 00000100:00100000:2.0:1788664165.187083:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140424832 00000100:00100000:2.0:1788664165.187087:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140424832 00000100:00100000:2.0:1788664165.187096:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140424960 00000100:00100000:2.0:1788664165.187098:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140424960 00000100:00100000:2.0:1788664165.187125:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140425088 00000100:00100000:2.0:1788664165.187128:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140425088 00000100:00100000:2.0:1788664165.187138:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140425216 00000100:00100000:2.0:1788664165.187140:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140425216 00000100:00100000:2.0:1788664165.187147:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140425344 00000100:00100000:2.0:1788664165.187149:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140425344 00000100:00100000:2.0:1788664165.187158:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140425472 00000100:00100000:2.0:1788664165.187175:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140425472 00000100:00100000:2.0:1788664165.187195:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788664165.187204:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+11:10326:x1875550140424448:12345-0@lo:104: 00010000:00010000:2.0:1788664165.187221:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c402a0d600/0xcd11f61c1413d6e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d6ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.187288:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664165.187295:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+11:10326:x1875550140424448:12345-0@lo:104: Request processed in 93us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664165.187302:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788664165.187321:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788664165.187327:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+10:10326:x1875550140424576:12345-0@lo:104: 00010000:00010000:2.0:1788664165.187335:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c402a0c400/0xcd11f61c1413d6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d6c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.187366:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788664165.187370:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+10:10326:x1875550140424576:12345-0@lo:104: Request processed in 44us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664165.187377:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788664165.187388:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788664165.187393:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+9:10326:x1875550140424704:12345-0@lo:104: 00010000:00010000:2.0:1788664165.187400:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4351ef800/0xcd11f61c1413d6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d6a7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.187442:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788664165.187447:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+9:10326:x1875550140424704:12345-0@lo:104: Request processed in 55us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664165.187452:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788664165.187471:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788664165.187477:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302550850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+8:10326:x1875550140424832:12345-0@lo:104: 00010000:00010000:2.0:1788664165.187484:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d67d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.187524:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788664165.187529:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302550850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+8:10326:x1875550140424832:12345-0@lo:104: Request processed in 53us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664165.187535:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788664165.187563:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788664165.187570:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+7:10326:x1875550140424960:12345-0@lo:104: 00010000:00010000:2.0:1788664165.187577:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.187603:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788664165.187609:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+7:10326:x1875550140424960:12345-0@lo:104: Request processed in 40us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664165.187615:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788664165.187628:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788664165.187634:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+6:10326:x1875550140425088:12345-0@lo:104: 00010000:00010000:2.0:1788664165.187641:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c402a0c600/0xcd11f61c1413d64c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.187667:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788664165.187672:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+6:10326:x1875550140425088:12345-0@lo:104: Request processed in 39us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664165.187678:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788664165.187697:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788664165.187703:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+5:10326:x1875550140425216:12345-0@lo:104: 00010000:00010000:2.0:1788664165.187711:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d645 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.187740:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788664165.187744:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+5:10326:x1875550140425216:12345-0@lo:104: Request processed in 42us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664165.187749:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788664165.187760:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788664165.187765:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:10326:x1875550140425344:12345-0@lo:104: 00010000:00010000:2.0:1788664165.187801:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c40153b400/0xcd11f61c1413d5ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d606 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.187830:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1788664165.187836:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:10326:x1875550140425344:12345-0@lo:104: Request processed in 71us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664165.187842:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788664165.187853:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788664165.187859:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:10326:x1875550140425472:12345-0@lo:104: 00010000:00010000:2.0:1788664165.187867:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d5d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d5dc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.187893:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1788664165.187898:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:10326:x1875550140425472:12345-0@lo:104: Request processed in 40us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664165.187904:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788664165.188321:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140424448:0@lo:104: 00000100:00100000:1.0:1788664165.188331:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140424576:0@lo:104: 00000100:00100000:1.0:1788664165.188338:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140424704:0@lo:104: 00000100:00100000:1.0:1788664165.188345:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140424832:0@lo:104: 00000100:00100000:1.0:1788664165.188352:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140424960:0@lo:104: 00000100:00100000:1.0:1788664165.188358:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140425088:0@lo:104: 00000100:00100000:1.0:1788664165.188366:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140425216:0@lo:104: 00000100:00100000:1.0:1788664165.188373:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303aba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140425344:0@lo:104: 00000100:00100000:1.0:1788664165.188379:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140425472:0@lo:104: 00010000:00010000:2.0:1788664165.190347:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788664165.190362:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c402a0d600/0xcd11f61c1413d6e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d6ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190374:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0d600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664165.190378:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c402a0d600/0xcd11f61c1413d6e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d6ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190387:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c402a0d600/0xcd11f61c1413d6e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d6ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664165.190394:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c402a0d600/0xcd11f61c1413d6e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d6ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664165.190400:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664165.190469:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c402a0d600/0xcd11f61c1413d6e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d6ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190477:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664165.190500:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c402a0d600/0xcd11f61c1413d6e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d6ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190518:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c402a0d600/0xcd11f61c1413d6e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d6ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190535:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788664165.190538:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c402a0c400/0xcd11f61c1413d6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d6c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190545:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664165.190548:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c402a0c400/0xcd11f61c1413d6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d6c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190570:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c402a0c400/0xcd11f61c1413d6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d6c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664165.190577:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c402a0c400/0xcd11f61c1413d6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d6c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664165.190583:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664165.190601:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c402a0c400/0xcd11f61c1413d6bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d6c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190606:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664165.190623:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c402a0c400/0xcd11f61c1413d6bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d6c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190629:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c402a0c400/0xcd11f61c1413d6bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d6c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190639:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788664165.190642:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4351ef800/0xcd11f61c1413d6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d6a7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190648:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ef800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664165.190651:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ef800/0xcd11f61c1413d6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d6a7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190658:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4351ef800/0xcd11f61c1413d6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d6a7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664165.190664:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ef800/0xcd11f61c1413d6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d6a7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664165.190674:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664165.190690:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4351ef800/0xcd11f61c1413d6a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d6a7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190695:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664165.190701:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4351ef800/0xcd11f61c1413d6a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d6a7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190708:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4351ef800/0xcd11f61c1413d6a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d6a7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190716:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788664165.190720:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d67d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190726:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ef000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664165.190729:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d67d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190736:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d67d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664165.190742:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d67d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664165.190747:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664165.190759:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d676 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d67d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190765:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664165.190814:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d676 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d67d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190820:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d676 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d67d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190830:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788664165.190833:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190839:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40153a800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664165.190842:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190848:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664165.190854:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664165.190859:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664165.190871:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d65a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190875:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664165.190879:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d65a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190884:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c40153a800/0xcd11f61c1413d65a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190892:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788664165.190900:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c402a0c600/0xcd11f61c1413d64c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190905:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664165.190908:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c402a0c600/0xcd11f61c1413d64c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190914:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c402a0c600/0xcd11f61c1413d64c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664165.190920:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c402a0c600/0xcd11f61c1413d64c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664165.190924:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664165.190936:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c402a0c600/0xcd11f61c1413d64c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190941:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664165.190945:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c402a0c600/0xcd11f61c1413d64c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190952:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c402a0c600/0xcd11f61c1413d64c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190960:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788664165.190964:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d645 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190969:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664165.190972:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d645 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.190987:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d63e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d645 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664165.190994:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d63e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d645 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664165.191000:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664165.191028:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d63e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d645 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.191035:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664165.191039:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d63e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d645 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.191046:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d63e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d645 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.191055:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788664165.191058:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c40153b400/0xcd11f61c1413d5ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d606 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.191076:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40153b400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664165.191079:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c40153b400/0xcd11f61c1413d5ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d606 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.191085:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c40153b400/0xcd11f61c1413d5ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d606 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664165.191091:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c40153b400/0xcd11f61c1413d5ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d606 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664165.191103:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664165.191117:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c40153b400/0xcd11f61c1413d5ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d606 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.191123:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664165.191127:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c40153b400/0xcd11f61c1413d5ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d606 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.191134:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c40153b400/0xcd11f61c1413d5ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d606 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.191143:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664165.191146:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d5d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d5dc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.191151:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ee600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664165.191154:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d5d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d5dc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.191162:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d5dc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.191983:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664165.192020:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140425984:0@lo:103: 00010000:00010000:1.0:1788664165.192209:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664165.192330:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664165.192385:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140426496:0@lo:103: 00000100:00100000:3.0:1788664165.192485:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664165.192525:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788664165.192533:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140425600:0@lo:103: 00000100:00100000:3.0:1788664165.192558:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664165.192580:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140426112:0@lo:103: 00000100:00100000:3.0:1788664165.192601:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664165.192634:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140425984 00000100:00100000:3.0:1788664165.192642:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140425984 00010000:00010000:3.0:1788664165.192688:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4351ef400/0xcd11f61c1413d67d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d676 expref: 24 pid: 6504 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664165.192711:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140426496 00000100:00100000:3.0:1788664165.192715:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140426496 00010000:00010000:3.0:1788664165.192726:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4351eee00/0xcd11f61c1413d606 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d5ff expref: 25 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664165.192736:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140425600 00000100:00100000:3.0:1788664165.192739:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140425600 00010000:00010000:3.0:1788664165.192748:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d6ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d6e6 expref: 26 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664165.192757:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140426112 00000100:00100000:3.0:1788664165.192759:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140426112 10000000:00010000:2.0:1788664165.193628:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d5dc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664165.193637:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664165.193674:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d5d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d5dc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.193681:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664165.193707:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d5d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d5dc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.193715:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d5d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d5dc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.193730:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664165.193732:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664165.193734:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664165.193751:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140425728:0@lo:103: 00000100:00100000:1.0:1788664165.193952:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788664165.193965:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c412c73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+27:3636:x1875550140425984:12345-0@lo:103: 00010000:00010000:1.0:1788664165.193979:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664165.193985:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4351ef400/0xcd11f61c1413d67d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d676 expref: 27 pid: 6504 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.193996:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4351ef400/0xcd11f61c1413d67d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d676 expref: 27 pid: 6504 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.194009:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4351ef400/0xcd11f61c1413d67d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d676 expref: 27 pid: 6504 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.194022:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664165.194122:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4351ee000/0xcd11f61c1413d661 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d65a expref: 26 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664165.194147:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788664165.194155:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+26:3636:x1875550140426496:12345-0@lo:103: 00010000:00010000:3.0:1788664165.194163:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664165.194178:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4351eee00/0xcd11f61c1413d606 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d5ff expref: 26 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.194186:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4351eee00/0xcd11f61c1413d606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d5ff expref: 26 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.194197:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4351eee00/0xcd11f61c1413d606 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d5ff expref: 26 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.194206:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664165.194638:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788664165.194648:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1788664165.195871:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c412c73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+25:3636:x1875550140425984:12345-0@lo:103: Request processed in 1902us (3533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664165.195883:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788664165.195957:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788664165.195968:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140425600:12345-0@lo:103: 00010000:00010000:1.0:1788664165.195983:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664165.195991:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d6ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d6e6 expref: 24 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.196002:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d6e6 expref: 24 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.196018:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d6ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d6e6 expref: 24 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.196032:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664165.196061:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+23:3636:x1875550140425600:12345-0@lo:103: Request processed in 97us (3502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664165.196082:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788664165.196097:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788664165.196104:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+22:3636:x1875550140426112:12345-0@lo:103: 00010000:00010000:1.0:1788664165.196112:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664165.196118:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4351ee000/0xcd11f61c1413d661 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d65a expref: 22 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.196126:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4351ee000/0xcd11f61c1413d661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d65a expref: 22 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.196135:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4351ee000/0xcd11f61c1413d661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d65a expref: 22 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.196144:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664165.196181:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+21:3636:x1875550140426112:12345-0@lo:103: Request processed in 78us (3578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664165.196194:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788664165.197283:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664165.197338:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140426240:0@lo:103: 00000100:00100000:2.0:1788664165.197372:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664165.197399:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788664165.197406:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140425856:0@lo:103: 00000100:00100000:1.0:1788664165.199652:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140425728 00000100:00100000:1.0:1788664165.199667:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140425728 00010000:00010000:1.0:1788664165.199712:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d6bc expref: 21 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.199740:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140426240 00000100:00100000:1.0:1788664165.199743:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140426240 00010000:00010000:1.0:1788664165.199757:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d653 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d64c expref: 22 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.199807:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788664165.199817:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+22:3638:x1875550140425728:12345-0@lo:103: 00010000:00010000:1.0:1788664165.199832:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664165.199838:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d6bc expref: 22 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.199848:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d6bc expref: 22 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.199866:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413d6c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d6bc expref: 22 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.199882:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664165.199953:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+21:3638:x1875550140425728:12345-0@lo:103: Request processed in 136us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664165.199961:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788664165.199977:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788664165.199983:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+20:3638:x1875550140426240:12345-0@lo:103: 00010000:00010000:1.0:1788664165.200006:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664165.200011:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d653 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d64c expref: 20 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.200020:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d64c expref: 20 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.200030:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d653 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d64c expref: 20 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.200040:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664165.200338:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+19:3638:x1875550140426240:12345-0@lo:103: Request processed in 354us (2963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664165.200346:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788664165.200669:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664165.200726:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140426368:0@lo:103: 00000100:00100000:2.0:1788664165.200757:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664165.200970:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140425728:0@lo:103: 00000100:00100000:2.0:1788664165.200982:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140426240:0@lo:103: 00000100:00100000:1.0:1788664165.201114:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140425856 00000100:00100000:1.0:1788664165.201120:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140425856 00010000:00010000:1.0:1788664165.201144:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4351efa00/0xcd11f61c1413d6a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d6a0 expref: 19 pid: 6504 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.201162:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140426368 00000100:00100000:1.0:1788664165.201165:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140426368 00000100:00100000:3.0:1788664165.201613:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+19:3636:x1875550140426496:12345-0@lo:103: Request processed in 7458us (9199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664165.201636:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788664165.201659:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788664165.201667:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+18:3638:x1875550140425856:12345-0@lo:103: 00010000:00010000:3.0:1788664165.201678:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664165.201684:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4351efa00/0xcd11f61c1413d6a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d6a0 expref: 18 pid: 6504 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.201694:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4351efa00/0xcd11f61c1413d6a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d6a0 expref: 18 pid: 6504 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.201710:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4351efa00/0xcd11f61c1413d6a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d6a0 expref: 18 pid: 6504 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.201723:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664165.201761:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+17:3638:x1875550140425856:12345-0@lo:103: Request processed in 96us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664165.201800:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788664165.201823:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140426624:0@lo:103: 00000100:00100000:3.0:1788664165.201850:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664165.201897:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140425600:0@lo:103: 00000100:00100000:3.0:1788664165.201907:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140426112:0@lo:103: 00000100:00100000:3.0:1788664165.201916:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140425984:0@lo:103: 00000100:00100000:3.0:1788664165.201924:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140426496:0@lo:103: 00000100:00100000:3.0:1788664165.201953:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140425856:0@lo:103: 00000100:00100000:3.0:1788664165.201968:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140426624 00000100:00100000:3.0:1788664165.201978:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140426624 00010000:00010000:3.0:1788664165.201996:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d5dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d5d5 expref: 17 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664165.202013:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788664165.202019:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+17:3637:x1875550140426624:12345-0@lo:103: 00010000:00010000:3.0:1788664165.202027:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664165.202030:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d5dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d5d5 expref: 17 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.202037:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d5d5 expref: 17 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.202047:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d5dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d5d5 expref: 17 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.202056:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664165.202102:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+16:3637:x1875550140426624:12345-0@lo:103: Request processed in 83us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664165.202108:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788664165.202130:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140426624:0@lo:103: 00010000:00010000:1.0:1788664165.202292:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c402a0ce00/0xcd11f61c1413d645 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d63e expref: 16 pid: 6504 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.202316:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788664165.202322:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c412c72050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+16:3638:x1875550140426368:12345-0@lo:103: 00010000:00010000:1.0:1788664165.202331:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664165.202335:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c402a0ce00/0xcd11f61c1413d645 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d63e expref: 16 pid: 6504 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.202353:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c402a0ce00/0xcd11f61c1413d645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d63e expref: 16 pid: 6504 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.202365:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0ce00/0xcd11f61c1413d645 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d63e expref: 16 pid: 6504 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.202374:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664165.202405:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c412c72050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+15:3638:x1875550140426368:12345-0@lo:103: Request processed in 83us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664165.202424:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788664165.202710:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140426368:0@lo:103: 00000100:00100000:3.0:1788664165.206831:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664165.206918:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119400832 00000100:00100000:0.0:1788664165.206929:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119400832 00000100:00100000:0.0:1788664165.206983:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 201 00000100:00100000:0.0:1788664165.206995:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6163:x1875550119400832:12345-192.168.203.52@tcp:101: 00010000:00010000:0.0:1788664165.207013:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664165.207032:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40153b200/0xcd11f61c1413d748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d196 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664165.207059:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664165.207084:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c40153b200/0xcd11f61c1413d748 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d196 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664165.207103:0:6506:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664165.207118:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40153b200/0xcd11f61c1413d748 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d196 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664165.207128:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40153b200, rc 0) 00000100:00100000:0.0:1788664165.207327:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:6163:x1875550119400832:12345-192.168.203.52@tcp:101: Request processed in 333us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664165.207336:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 201 00000100:00100000:1.0:1788664165.207493:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140424192:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664165.213075:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875550140424320:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664165.213131:0:10326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664165.233659:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664165.233964:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119400960 00000100:00100000:1.0:1788664165.233974:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119400960 00010000:00010000:1.0:1788664165.234014:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c40153be00/0xcd11f61c1413d702 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d126 expref: 11 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664165.234050:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:1.0:1788664165.234061:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:2391:x1875550119400960:12345-192.168.203.52@tcp:103: 00010000:00010000:1.0:1788664165.234086:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664165.234093:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c40153be00/0xcd11f61c1413d702 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d126 expref: 11 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.234107:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c40153be00/0xcd11f61c1413d702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d126 expref: 11 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.234139:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40153be00/0xcd11f61c1413d702 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d126 expref: 11 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.234157:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664165.234404:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2391:x1875550119400960:12345-192.168.203.52@tcp:103: Request processed in 344us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664165.234420:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1788664165.238090:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664165.238174:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119401088 00000100:00100000:3.0:1788664165.238185:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119401088 00010000:00010000:3.0:1788664165.238225:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d6fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d11f expref: 10 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664165.238291:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:3.0:1788664165.238301:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2390:x1875550119401088:12345-192.168.203.52@tcp:103: 00010000:00010000:3.0:1788664165.238317:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664165.238324:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d6fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d11f expref: 10 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.238337:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d11f expref: 10 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.238355:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0ca00/0xcd11f61c1413d6fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d11f expref: 10 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.238373:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.238382:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.238400:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.238408:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.238414:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.238421:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.238436:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664165.238440:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.238447:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.238470:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c40153b200/0xcd11f61c1413d748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d196 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.238476:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40153b200/0xcd11f61c1413d748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d196 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664165.238511:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff93c40153b200/0xcd11f61c1413d748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d196 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664165.238525:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:6498:1875550140426752:192.168.203.52@tcp:105: 00010000:00010000:1.0:1788664165.238560:0:10326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.238571:0:10326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664165.238617:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3038a1000 going to sleep for 11 seconds 00000100:00100000:2.0:1788664165.244745:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:6498:1875550140426752:192.168.203.52@tcp:105: 00010000:00010000:2.0:1788664165.244806:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.244820:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413d741 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664165.244854:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664165.244915:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:2390:x1875550119401088:12345-192.168.203.52@tcp:103: Request processed in 6615us (6833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664165.244925:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:2.0:1788664165.250817:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664165.255892:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119401216 00000100:00100000:0.0:1788664165.255924:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119401216 00000100:00100000:0.0:1788664165.255995:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00100000:0.0:1788664165.256007:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:6163:x1875550119401216:12345-192.168.203.52@tcp:501: 00000100:00100000:0.0:1788664165.256193:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:6163:x1875550119401216:12345-192.168.203.52@tcp:501: Request processed in 188us (5787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664165.256202:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00100000:3.0:1788664165.269105:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664165.269159:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119401344 00000100:00100000:1.0:1788664165.269170:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119401344 00000100:00100000:1.0:1788664165.269221:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 203 00000100:00100000:1.0:1788664165.269232:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:6163:x1875550119401344:12345-192.168.203.52@tcp:503: 00000100:00100000:1.0:1788664165.269407:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:6163:x1875550119401344:12345-192.168.203.52@tcp:503: Request processed in 176us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664165.269416:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 203 00000100:00100000:3.0:1788664165.292420:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664165.295481:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119401472 00000100:00100000:1.0:1788664165.295497:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119401472 00000100:00100000:1.0:1788664165.295606:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:1.0:1788664165.295617:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:6633:x1875550119401472:12345-192.168.203.52@tcp:502: 00000100:00100000:1.0:1788664165.296210:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:6633:x1875550119401472:12345-192.168.203.52@tcp:502: Request processed in 590us (3794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664165.296231:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:0.0:1788664165.309474:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664165.309520:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119401600 00000100:00100000:0.0:1788664165.309530:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119401600 00000100:00100000:0.0:1788664165.309577:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:0.0:1788664165.309586:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:6633:x1875550119401600:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788664165.309734:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:6633:x1875550119401600:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 148us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664165.309741:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:3.0:1788664165.315539:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664165.315636:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119401728 00000100:00100000:1.0:1788664165.315647:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119401728 00000100:00100000:1.0:1788664165.315705:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:1.0:1788664165.315715:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:6163:x1875550119401728:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664165.315732:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664165.315761:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4029e3a00/0xcd11f61c1413d74f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d19d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.315822:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e3a00/0xcd11f61c1413d74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d19d expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.315835:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4029e3a00/0xcd11f61c1413d74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d19d expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664165.315844:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e3a00, rc 0) 00000100:00100000:1.0:1788664165.315898:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6163:x1875550119401728:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 184us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664165.315905:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:3.0:1788664165.319589:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664165.319626:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119401856 00000100:00100000:3.0:1788664165.319636:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119401856 00000100:00100000:3.0:1788664165.319684:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:3.0:1788664165.319693:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6163:x1875550119401856:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664165.319834:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6163:x1875550119401856:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 141us (253us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788664165.319848:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 207 00010000:00010000:3.0:1788664165.825808:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788664166.291269:0:10380:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffceac1a960 20000000:00000080:0.0:1788664166.291287:0:10380:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c3039cd800 uarg=0000000000000000 20000000:01000000:0.0:1788664166.291390:0:10380:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788664166.291396:0:10380:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788664166.291400:0:10380:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788664166.291762:0:10381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788664166.294286:0:10380:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788664166.302429:0:10380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788664166.302548:0:10380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788664166.302569:0:10380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788664166.302586:0:10380:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788664166.302607:0:10380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d756 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664166.302626:0:10380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4351ef600/0xcd11f61c1413d470 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d469 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664166.302650:0:10380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c400031600/0xcd11f61c1413d47e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d477 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664166.302658:0:10380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c402a0de00/0xcd11f61c1413d4d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d4cb expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664166.302666:0:10380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d5f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d5f1 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664166.302677:0:10380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d710 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d15e expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664166.302686:0:10380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d756 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664166.302730:0:10380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d15e expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664166.302980:0:10380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d710 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d15e expref: 9 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664166.302998:0:10380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f763800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10380:1875550140426880:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788664166.303130:0:10380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d5f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d5f1 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664166.303139:0:10380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d5f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d5f1 expref: 14 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664166.303150:0:10380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f760a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10380:1875550140427008:0@lo:104: 00000100:00100000:0.0:1788664166.303206:0:10380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788664166.303243:0:10380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c402a0de00/0xcd11f61c1413d4d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d4cb expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664166.303251:0:10380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c402a0de00/0xcd11f61c1413d4d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d4cb expref: 14 pid: 6506 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664166.303259:0:10380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f763b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10380:1875550140427136:0@lo:104: 00000100:00100000:0.0:1788664166.303281:0:10380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788664166.303301:0:10380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c400031600/0xcd11f61c1413d47e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d477 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664166.303309:0:10380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c400031600/0xcd11f61c1413d47e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d477 expref: 14 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664166.303317:0:10380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10380:1875550140427264:0@lo:104: 00010000:00010000:0.0:1788664166.303425:0:10380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4351ef600/0xcd11f61c1413d470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d469 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664166.303434:0:10380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c4351ef600/0xcd11f61c1413d470 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d469 expref: 14 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664166.303442:0:10380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10380:1875550140427392:0@lo:104: 00000100:00100000:0.0:1788664166.303474:0:10380:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664166.303552:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788664166.303572:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664166.303585:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664166.303593:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140427008 00000100:00100000:2.0:1788664166.303599:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140427008 00000100:00100000:2.0:1788664166.303633:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140427136 00000100:00100000:2.0:1788664166.303636:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140427136 00000100:00100000:2.0:1788664166.303645:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140427264 00000100:00100000:2.0:1788664166.303647:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140427264 00000100:00100000:2.0:1788664166.303655:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140427392 00000100:00100000:2.0:1788664166.303656:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140427392 00000100:00100000:2.0:1788664166.303669:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788664166.303677:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+6:10380:x1875550140427008:12345-0@lo:104: 00010000:00010000:2.0:1788664166.303690:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4351eea00/0xcd11f61c1413d5f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d5f8 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.303755:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664166.303762:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+6:10380:x1875550140427008:12345-0@lo:104: Request processed in 86us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664166.303794:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788664166.303811:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788664166.303818:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+5:10380:x1875550140427136:12345-0@lo:104: 00010000:00010000:2.0:1788664166.303826:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4029e3200/0xcd11f61c1413d4cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d4d2 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.303867:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788664166.303873:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+5:10380:x1875550140427136:12345-0@lo:104: Request processed in 56us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664166.303879:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788664166.303910:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788664166.303917:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:10380:x1875550140427264:12345-0@lo:104: 00010000:00010000:2.0:1788664166.303924:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d477 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d47e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.303955:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788664166.303960:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:10380:x1875550140427264:12345-0@lo:104: Request processed in 45us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664166.303965:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788664166.303979:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788664166.303984:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:10380:x1875550140427392:12345-0@lo:104: 00010000:00010000:2.0:1788664166.303991:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d470 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304014:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788664166.304018:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:10380:x1875550140427392:12345-0@lo:104: Request processed in 35us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664166.304023:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788664166.304043:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788664166.304048:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4351eea00/0xcd11f61c1413d5f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d5f8 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304055:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351eea00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664166.304065:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4351eea00/0xcd11f61c1413d5f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d5f8 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304074:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4351eea00/0xcd11f61c1413d5f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d5f8 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664166.304081:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4351eea00/0xcd11f61c1413d5f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d5f8 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664166.304087:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788664166.304112:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4351eea00/0xcd11f61c1413d5f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d5f8 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304118:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664166.304135:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4351eea00/0xcd11f61c1413d5f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d5f8 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304141:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4351eea00/0xcd11f61c1413d5f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d5f8 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304154:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788664166.304158:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4029e3200/0xcd11f61c1413d4cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d4d2 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304164:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e3200 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664166.304167:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e3200/0xcd11f61c1413d4cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d4d2 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304173:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4029e3200/0xcd11f61c1413d4cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d4d2 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664166.304189:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e3200/0xcd11f61c1413d4cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d4d2 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664166.304195:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788664166.304207:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4029e3200/0xcd11f61c1413d4cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d4d2 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304212:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664166.304217:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4029e3200/0xcd11f61c1413d4cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d4d2 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304224:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4029e3200/0xcd11f61c1413d4cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d4d2 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304232:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788664166.304236:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d477 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d47e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304241:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664166.304244:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d477 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d47e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304250:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d477 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d47e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664166.304256:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d477 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d47e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664166.304261:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788664166.304277:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d477 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d47e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304282:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664166.304295:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d477 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d47e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304301:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d477 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d47e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304310:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664166.304313:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d470 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304318:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ee800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664166.304321:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d470 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664166.304534:0:10380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f760a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10380:1875550140427008:0@lo:104: 00000100:00100000:0.0:1788664166.304543:0:10380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f763b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10380:1875550140427136:0@lo:104: 00000100:00100000:0.0:1788664166.304550:0:10380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10380:1875550140427264:0@lo:104: 00000100:00100000:0.0:1788664166.304556:0:10380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10380:1875550140427392:0@lo:104: 00010000:00010000:2.0:1788664166.304670:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d469 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d470 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664166.304680:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d469 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d470 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664166.304689:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788664166.304706:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d469 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d470 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304712:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664166.304717:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d469 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d470 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304735:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d469 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d470 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.304748:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664166.304750:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664166.304752:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664166.304765:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140427648:0@lo:103: 00000100:00100000:2.0:1788664166.304829:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664166.304865:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664166.304872:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140427520:0@lo:103: 00000100:00100000:2.0:1788664166.304892:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664166.304920:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140427648 00000100:00100000:2.0:1788664166.304925:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140427648 00010000:00010000:2.0:1788664166.304947:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c402a0de00/0xcd11f61c1413d4d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d4cb expref: 15 pid: 6506 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664166.304970:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140427520 00000100:00100000:2.0:1788664166.304973:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140427520 00010000:00010000:2.0:1788664166.304984:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d5f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d5f1 expref: 16 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664166.305003:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788664166.305010:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+16:3639:x1875550140427648:12345-0@lo:103: 00010000:00010000:2.0:1788664166.305020:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664166.305026:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c402a0de00/0xcd11f61c1413d4d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d4cb expref: 16 pid: 6506 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.305035:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c402a0de00/0xcd11f61c1413d4d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d4cb expref: 16 pid: 6506 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.305054:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0de00/0xcd11f61c1413d4d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d4cb expref: 16 pid: 6506 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.305066:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664166.305093:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+15:3639:x1875550140427648:12345-0@lo:103: Request processed in 84us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664166.305100:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788664166.305114:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788664166.305120:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+14:3639:x1875550140427520:12345-0@lo:103: 00010000:00010000:2.0:1788664166.305128:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664166.305133:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d5f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d5f1 expref: 14 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.305140:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d5f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d5f1 expref: 14 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.305149:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d5f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d5f1 expref: 14 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664166.305169:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664166.305192:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+13:3639:x1875550140427520:12345-0@lo:103: Request processed in 73us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664166.305197:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788664166.305224:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140427520:0@lo:103: 00000100:00100000:2.0:1788664166.305231:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140427648:0@lo:103: 00010000:00010000:1.0:1788664166.305767:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664166.307488:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140427776:0@lo:103: 00000100:00100000:0.0:1788664166.307564:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664166.307616:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664166.307623:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140427904:0@lo:103: 00000100:00100000:0.0:1788664166.307649:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788664166.307683:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664166.308276:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140427776 00000100:00100000:1.0:1788664166.308285:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140427776 00010000:00010000:1.0:1788664166.308319:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c400031600/0xcd11f61c1413d47e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d477 expref: 13 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664166.308365:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140427904 00000100:00100000:1.0:1788664166.308368:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140427904 00010000:00010000:1.0:1788664166.308381:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4351ef600/0xcd11f61c1413d470 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d469 expref: 14 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664166.308421:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788664166.308429:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+14:3636:x1875550140427776:12345-0@lo:103: 00010000:00010000:1.0:1788664166.308444:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664166.308450:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c400031600/0xcd11f61c1413d47e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d477 expref: 14 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.308473:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c400031600/0xcd11f61c1413d47e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d477 expref: 14 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.308492:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c400031600/0xcd11f61c1413d47e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d477 expref: 14 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.308518:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664166.308562:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+13:3636:x1875550140427776:12345-0@lo:103: Request processed in 134us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664166.308569:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788664166.308586:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788664166.308593:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c412c73850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+12:3636:x1875550140427904:12345-0@lo:103: 00010000:00010000:1.0:1788664166.308600:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664166.308605:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4351ef600/0xcd11f61c1413d470 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d469 expref: 12 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.308613:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4351ef600/0xcd11f61c1413d470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d469 expref: 12 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.308623:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4351ef600/0xcd11f61c1413d470 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d469 expref: 12 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.308643:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664166.308667:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c412c73850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+11:3636:x1875550140427904:12345-0@lo:103: Request processed in 75us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664166.308673:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788664166.308763:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140427904:0@lo:103: 00000100:00100000:1.0:1788664166.308807:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140427776:0@lo:103: 00000100:00100000:3.0:1788664166.315076:0:10380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f763800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10380:1875550140426880:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664166.315117:0:10380:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d756 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664166.319404:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664166.319683:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119401984 00000100:00100000:1.0:1788664166.319693:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119401984 00010000:00010000:1.0:1788664166.319734:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d710 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d15e expref: 10 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664166.319824:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1788664166.319835:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2391:x1875550119401984:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664166.319850:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664166.319856:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d710 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d15e expref: 10 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.319870:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d15e expref: 10 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.319888:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40153b800/0xcd11f61c1413d710 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d15e expref: 10 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.319905:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d756 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.319915:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d756 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.319944:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d756 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.319951:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d756 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.319957:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d756 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.319964:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d756 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.319972:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40153b400 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664166.319976:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d756 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.319985:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d756 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.320012:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d756 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.320031:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664166.320082:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:2391:x1875550119401984:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 248us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664166.320091:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00010000:00010000:3.0:1788664166.321802:0:10380:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d756 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664166.321819:0:10380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d756 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664166.321826:0:10380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d756 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664166.704725:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664166.704803:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119402112 00000100:00100000:1.0:1788664166.704815:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119402112 00000100:00100000:1.0:1788664166.704925:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 208 00000100:00100000:1.0:1788664166.704937:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:6163:x1875550119402112:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664166.704967:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664166.704987:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4029e3c00/0xcd11f61c1413d75d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d1a4 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.705016:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e3c00/0xcd11f61c1413d75d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1a4 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.705028:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4029e3c00/0xcd11f61c1413d75d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1a4 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664166.705037:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e3c00, rc 0) 00000100:00100000:1.0:1788664166.705115:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6163:x1875550119402112:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 180us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664166.705122:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 208 00000100:00100000:1.0:1788664166.710860:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664166.710943:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119402240 00000100:00100000:3.0:1788664166.710954:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119402240 00000100:00100000:3.0:1788664166.711012:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:3.0:1788664166.711021:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6163:x1875550119402240:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664166.711184:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6163:x1875550119402240:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 163us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664166.711193:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:2.0:1788664166.714628:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664166.714712:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119402368 00000100:00100000:1.0:1788664166.714721:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119402368 00000100:00100000:1.0:1788664166.714811:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:1.0:1788664166.714821:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6163:x1875550119402368:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664166.714962:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6163:x1875550119402368:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 141us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664166.714969:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:0.0:1788664166.726522:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664166.726845:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119402496 00000100:00100000:3.0:1788664166.726856:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119402496 00000100:00100000:3.0:1788664166.726913:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:3.0:1788664166.726923:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6680:x1875550119402496:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788664166.727083:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6680:x1875550119402496:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 160us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664166.727091:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:2.0:1788664166.734638:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664166.735436:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119402624 00000100:00100000:0.0:1788664166.735447:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119402624 00000100:00100000:0.0:1788664166.735688:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:0.0:1788664166.735702:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6680:x1875550119402624:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788664166.735883:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:6680:x1875550119402624:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 184us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664166.735892:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 212 00010000:00010000:2.0:1788664166.847223:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664166.982577:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664166.982602:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140428032:0@lo:41: 00000100:00100000:1.0:1788664166.982674:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664166.982760:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140428032 00000100:00100000:1.0:1788664166.982767:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140428032 00000100:00100000:1.0:1788664166.982842:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788664166.982851:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140428032:12345-0@lo:41: 00000004:00000024:1.0:1788664166.982885:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788664166.982929:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140428032:12345-0@lo:41: Request processed in 80us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664166.982949:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788664166.982999:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140428032:0@lo:41: 10000000:01000000:1.0:1788664167.101853:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788664167.101861:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c302578800 from 48 10000000:01000000:1.0:1788664167.101867:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788664167.101917:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.101929:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.101941:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664167.101965:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140428160:0@lo:101: 00000100:00100000:1.0:1788664167.102044:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.102114:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c30396db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.102421:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140428160 00000100:00100000:0.0:1788664167.102429:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140428160 00000100:00100000:0.0:1788664167.102660:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788664167.102672:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+11:6508:x1875550140428160:12345-0@lo:101: 00010000:00010000:0.0:1788664167.102687:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664167.102701:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d76b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d764 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.102727:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d76b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d764 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.102737:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d76b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d764 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.102762:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40153b400, rc 0) 00000100:00100000:0.0:1788664167.102834:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+12:6508:x1875550140428160:12345-0@lo:101: Request processed in 165us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.102842:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788664167.102924:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140428160:0@lo:101: 00010000:00010000:1.0:1788664167.102941:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d76b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.102950:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d76b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664167.103027:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140428288:0@lo:501: 00000100:00100000:1.0:1788664167.103068:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.108882:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c30396db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.115909:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140428288 00000100:00100000:3.0:1788664167.115926:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140428288 00000100:00100000:3.0:1788664167.117023:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788664167.117037:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:6508:x1875550140428288:12345-0@lo:501: 00000100:00100000:3.0:1788664167.117366:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:6508:x1875550140428288:12345-0@lo:501: Request processed in 331us (14295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.117373:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788664167.118865:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140428288:0@lo:501: 00000100:00100000:0.0:1788664167.118931:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140428416:0@lo:503: 00000100:00100000:0.0:1788664167.119009:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.119047:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.119459:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140428416 00000100:00100000:3.0:1788664167.119466:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140428416 00000100:00100000:3.0:1788664167.119525:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788664167.119534:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:6508:x1875550140428416:12345-0@lo:503: 00000100:00100000:3.0:1788664167.119949:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:6508:x1875550140428416:12345-0@lo:503: Request processed in 415us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.119957:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788664167.120121:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140428416:0@lo:503: 00000100:00100000:1.0:1788664167.125878:0:10401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10401:1875550140428544:0@lo:502: 00000100:00100000:1.0:1788664167.125971:0:10401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.126005:0:10401:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c30396d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.126148:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140428544 00000100:00100000:0.0:1788664167.126157:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140428544 00000100:00100000:0.0:1788664167.126202:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788664167.126210:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+12:10401:x1875550140428544:12345-0@lo:502: 00000100:00100000:0.0:1788664167.126365:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+12:10401:x1875550140428544:12345-0@lo:502: Request processed in 155us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.126373:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788664167.130198:0:10401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10401:1875550140428544:0@lo:502: 00000100:00100000:1.0:1788664167.130278:0:10401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10401:1875550140428672:0@lo:502: 00000100:00100000:1.0:1788664167.138420:0:10401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.138488:0:10401:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c30396d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.138684:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140428672 00000100:00100000:0.0:1788664167.138694:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140428672 00000100:00100000:0.0:1788664167.139204:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788664167.139217:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:10401:x1875550140428672:12345-0@lo:502: 00000100:00100000:0.0:1788664167.139516:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+12:10401:x1875550140428672:12345-0@lo:502: Request processed in 302us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.139524:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788664167.142183:0:10401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10401:1875550140428672:0@lo:502: 00000040:00080000:1.0:1788664167.142233:0:10401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788664167.143333:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788664167.143380:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788664167.143390:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d76b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.143401:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d76b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664167.143411:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788664167.143414:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788664167.143416:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788664167.143456:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.143463:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.143472:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.143502:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140428800:0@lo:101: 00000100:00100000:0.0:1788664167.143567:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.143607:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.143627:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140428800 00000100:00100000:0.0:1788664167.143634:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140428800 00000100:00100000:0.0:1788664167.143672:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788664167.143680:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+12:6508:x1875550140428800:12345-0@lo:101: 00010000:00010000:0.0:1788664167.143692:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664167.143704:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40153b600/0xcd11f61c1413d779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d772 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.143739:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40153b600/0xcd11f61c1413d779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d772 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.143749:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40153b600/0xcd11f61c1413d779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d772 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.143757:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40153b600, rc 0) 00000100:00100000:0.0:1788664167.143811:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+13:6508:x1875550140428800:12345-0@lo:101: Request processed in 130us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.143818:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788664167.143863:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140428800:0@lo:101: 00010000:00010000:0.0:1788664167.143877:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d779 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.143885:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d779 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.146685:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140428928:0@lo:501: 00000100:00100000:0.0:1788664167.146758:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.146823:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.147408:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140428928 00000100:00100000:1.0:1788664167.147417:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140428928 00000100:00100000:1.0:1788664167.147461:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788664167.147470:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+13:6508:x1875550140428928:12345-0@lo:501: 00000100:00100000:1.0:1788664167.147638:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+13:6508:x1875550140428928:12345-0@lo:501: Request processed in 168us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.147647:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788664167.147693:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140428928:0@lo:501: 00000100:00100000:1.0:1788664167.147733:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140429056:0@lo:503: 00000100:00100000:1.0:1788664167.147804:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.147837:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c30396d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.148019:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140429056 00000100:00100000:2.0:1788664167.148025:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140429056 00000100:00100000:2.0:1788664167.148063:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788664167.148070:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+13:6508:x1875550140429056:12345-0@lo:503: 00000100:00100000:2.0:1788664167.148155:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+13:6508:x1875550140429056:12345-0@lo:503: Request processed in 85us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.148162:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788664167.150250:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140429056:0@lo:503: 00000100:00100000:2.0:1788664167.159713:0:10402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10402:1875550140429184:0@lo:502: 00000100:00100000:2.0:1788664167.159986:0:10402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.160034:0:10402:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f7916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.160074:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140429184 00000100:00100000:1.0:1788664167.160084:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140429184 00000100:00100000:1.0:1788664167.160144:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788664167.160156:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+13:10402:x1875550140429184:12345-0@lo:502: 00000100:00100000:1.0:1788664167.160304:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+13:10402:x1875550140429184:12345-0@lo:502: Request processed in 151us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.160314:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788664167.160347:0:10402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10402:1875550140429184:0@lo:502: 00000020:01000000:2.0:1788664167.160379:0:10402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664167.160390:0:10402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664167.160392:0:10402:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788664167.160466:0:10402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788664167.160500:0:10402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10402:1875550140429312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.160535:0:10402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.160668:0:10402:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f7916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.161278:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140429312 00000100:00100000:1.0:1788664167.161285:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140429312 00000100:00100000:1.0:1788664167.161327:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788664167.161337:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+13:10402:x1875550140429312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664167.161441:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+13:10402:x1875550140429312:12345-0@lo:502:llog_process_th.0 Request processed in 105us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.161450:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788664167.161518:0:10402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10402:1875550140429312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664167.161569:0:10402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664167.161575:0:10402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664167.161587:0:10402:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788664167.161592:0:10402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1788664167.163195:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788664167.163229:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788664167.163242:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d779 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.163256:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d779 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664167.163267:0:6508:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788664167.163271:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c302578800 from 4 10000000:01000000:1.0:1788664167.163274:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664167.163314:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413d780 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.163340:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413d780 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.163352:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413d780 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664167.163377:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140429440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788664167.163434:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.164001:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c30396d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.171988:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140429440 00000100:00100000:2.0:1788664167.172012:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140429440 00000100:00100000:2.0:1788664167.172083:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788664167.172094:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+13:6508:x1875550140429440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664167.172125:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664167.172144:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c400030800/0xcd11f61c1413d787 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d780 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.172172:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c400030800/0xcd11f61c1413d787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d780 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.172185:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c400030800/0xcd11f61c1413d787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d780 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.172194:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400030800, rc 0) 00000100:00100000:2.0:1788664167.172276:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+14:6508:x1875550140429440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (8841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.172283:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788664167.172502:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140429440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664167.172521:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413d780 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d787 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.172531:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413d780 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d787 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664167.172605:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140429568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664167.172639:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.172675:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c30396d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.172813:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140429568 00000100:00100000:0.0:1788664167.172819:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140429568 00000100:00100000:0.0:1788664167.172849:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788664167.172856:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+14:6508:x1875550140429568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664167.172999:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+14:6508:x1875550140429568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.173018:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788664167.173284:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140429568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.173320:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140429696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.173367:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.173385:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c408731cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.173457:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140429696 00000100:00100000:2.0:1788664167.173461:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140429696 00000100:00100000:2.0:1788664167.173503:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788664167.173511:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+14:6508:x1875550140429696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.173604:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+14:6508:x1875550140429696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.173611:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788664167.173650:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140429696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.173879:0:10403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10403:1875550140429824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.173914:0:10403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.174141:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140429824 00000100:00100000:1.0:1788664167.174146:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140429824 00000100:00100000:1.0:1788664167.174169:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788664167.174175:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+14:10403:x1875550140429824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664167.174250:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+14:10403:x1875550140429824:12345-0@lo:502:llog_process_th.0 Request processed in 75us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.174257:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788664167.174466:0:10403:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f791300 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.174484:0:10403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10403:1875550140429824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664167.174527:0:10403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664167.174536:0:10403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664167.174539:0:10403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788664167.174545:0:10403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c302578800 00000020:00000080:2.0:1788664167.174547:0:10403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788664167.174664:0:10403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10403:1875550140429952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.174704:0:10403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.174727:0:10403:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f791300 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.174809:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140429952 00000100:00100000:1.0:1788664167.174814:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140429952 00000100:00100000:1.0:1788664167.174841:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788664167.174848:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+14:10403:x1875550140429952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664167.174916:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+14:10403:x1875550140429952:12345-0@lo:502:llog_process_th.0 Request processed in 68us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.174924:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788664167.175449:0:10403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10403:1875550140429952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664167.175472:0:10403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664167.175478:0:10403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664167.175480:0:10403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788664167.175483:0:10403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788664167.175643:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788664167.175667:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788664167.175677:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413d780 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d787 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.175687:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413d780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d787 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664167.175696:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788664167.175698:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c42f78b000 from 48 10000000:01000000:0.0:1788664167.175701:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788664167.175729:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.175736:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.175744:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.175759:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140430080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788664167.175835:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.175866:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.176164:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140430080 00000100:00100000:1.0:1788664167.176170:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140430080 00000100:00100000:1.0:1788664167.176209:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788664167.176217:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+14:6508:x1875550140430080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664167.176228:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664167.176240:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d795 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d78e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.176263:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d78e expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.176273:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d78e expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.176281:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e2600, rc 0) 00000100:00100000:1.0:1788664167.176320:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140430080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.176326:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788664167.180267:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140430080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664167.180297:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.180310:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664167.180405:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140430208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.180471:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.180518:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f791300 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.181450:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140430208 00000100:00100000:0.0:1788664167.181459:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140430208 00000100:00100000:0.0:1788664167.181522:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788664167.181532:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140430208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664167.181694:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140430208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.181715:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788664167.181845:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140430208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.181892:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140430336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.181951:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.181983:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f791300 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.182219:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140430336 00000100:00100000:0.0:1788664167.182225:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140430336 00000100:00100000:0.0:1788664167.182263:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788664167.182270:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140430336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664167.182356:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140430336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.182364:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788664167.183201:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140430336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664167.191630:0:10404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10404:1875550140430464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664167.191719:0:10404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.191766:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140430464 00000100:00100000:0.0:1788664167.191798:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140430464 00000100:00100000:0.0:1788664167.191852:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788664167.191862:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c420ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:10404:x1875550140430464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664167.191983:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c420ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+15:10404:x1875550140430464:12345-0@lo:502:llog_process_th.0 Request processed in 122us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.191991:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788664167.192040:0:10404:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.192061:0:10404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10404:1875550140430464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664167.192103:0:10404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10404:1875550140430592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664167.192137:0:10404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.192150:0:10404:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.193189:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140430592 00000100:00100000:2.0:1788664167.193198:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140430592 00000100:00100000:2.0:1788664167.193235:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788664167.193244:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c410474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:10404:x1875550140430592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.194136:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c410474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:10404:x1875550140430592:12345-0@lo:502:llog_process_th.0 Request processed in 888us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.194148:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788664167.198841:0:10404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10404:1875550140430592:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788664167.198898:0:10404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788664167.199400:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788664167.199424:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788664167.199434:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.199445:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664167.199455:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788664167.199458:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788664167.199461:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788664167.199505:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.199515:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.199524:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664167.199546:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140430720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.199637:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.199688:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f791180 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.199709:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140430720 00000100:00100000:2.0:1788664167.199716:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140430720 00000100:00100000:2.0:1788664167.199759:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788664167.199768:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c410475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+15:6508:x1875550140430720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664167.199811:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664167.199825:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c400031600/0xcd11f61c1413d7a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d79c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.199849:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c400031600/0xcd11f61c1413d7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d79c expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.199858:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c400031600/0xcd11f61c1413d7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d79c expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.199866:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400031600, rc 0) 00000100:00100000:2.0:1788664167.199903:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c410475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140430720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.199910:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788664167.200105:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140430720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664167.200119:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.200128:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d7a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664167.200184:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140430848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.200219:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.200232:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f791180 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.200243:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140430848 00000100:00100000:2.0:1788664167.200246:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140430848 00000100:00100000:2.0:1788664167.200265:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788664167.200270:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c421997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140430848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.200641:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c421997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140430848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 368us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.200649:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788664167.204434:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140430848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.204506:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140430976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.204584:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.204621:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f791180 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.204867:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140430976 00000100:00100000:1.0:1788664167.204875:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140430976 00000100:00100000:1.0:1788664167.204918:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788664167.204927:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140430976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664167.205187:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140430976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 260us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.205195:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788664167.205246:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140430976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664167.209449:0:10406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10406:1875550140431104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664167.209549:0:10406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.209586:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140431104 00000100:00100000:1.0:1788664167.209592:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140431104 00000100:00100000:1.0:1788664167.209640:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788664167.209649:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:10406:x1875550140431104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664167.209787:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+16:10406:x1875550140431104:12345-0@lo:502:llog_process_th.0 Request processed in 120us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.209795:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788664167.209833:0:10406:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c30396da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.209856:0:10406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10406:1875550140431104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788664167.209884:0:10406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664167.209894:0:10406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664167.209896:0:10406:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788664167.209901:0:10406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788664167.209920:0:10406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10406:1875550140431232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664167.209952:0:10406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.209972:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140431232 00000100:00100000:1.0:1788664167.209975:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140431232 00000100:00100000:1.0:1788664167.210010:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788664167.210017:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:10406:x1875550140431232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664167.211180:0:10406:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c40385e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.213290:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+16:10406:x1875550140431232:12345-0@lo:502:llog_process_th.0 Request processed in 3264us (3329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.213303:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788664167.216304:0:10406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10406:1875550140431232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664167.216349:0:10406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664167.216358:0:10406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664167.216360:0:10406:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788664167.216371:0:10406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1788664167.216484:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788664167.216517:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788664167.216528:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.216539:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664167.216714:0:6508:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:2.0:1788664167.216719:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c42f78b000 from 4 10000000:01000000:2.0:1788664167.216722:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788664167.216758:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d7aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.216765:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d7aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.216808:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d7aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664167.216834:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140431360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.216901:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.217009:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f791d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.217028:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140431360 00000100:00100000:2.0:1788664167.217034:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140431360 00000100:00100000:2.0:1788664167.217074:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788664167.217083:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+16:6508:x1875550140431360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664167.217096:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664167.217108:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c400030a00/0xcd11f61c1413d7b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d7aa expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.217130:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c400030a00/0xcd11f61c1413d7b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d7aa expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.217140:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c400030a00/0xcd11f61c1413d7b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d7aa expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.217149:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400030a00, rc 0) 00000100:00100000:2.0:1788664167.217185:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140431360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.217192:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788664167.217232:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140431360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664167.217245:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d7aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.217258:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d7aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d7b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664167.218086:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140431488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.218125:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.218147:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f791d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.218167:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140431488 00000100:00100000:2.0:1788664167.218171:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140431488 00000100:00100000:2.0:1788664167.218199:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788664167.218206:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140431488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.219196:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140431488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 987us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.219207:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788664167.219261:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140431488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.219728:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140431616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.219792:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.219809:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f791d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.219825:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140431616 00000100:00100000:2.0:1788664167.219829:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140431616 00000100:00100000:2.0:1788664167.219862:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788664167.219869:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140431616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.220416:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140431616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 546us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.220425:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788664167.220975:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140431616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.221858:0:10409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10409:1875550140431744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.221921:0:10409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.223794:0:10409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f791480 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.231525:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140431744 00000100:00100000:3.0:1788664167.231540:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140431744 00000100:00100000:3.0:1788664167.233441:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788664167.233453:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:10409:x1875550140431744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664167.233839:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:10409:x1875550140431744:12345-0@lo:502:llog_process_th.0 Request processed in 387us (11916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.233847:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788664167.237659:0:10409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10409:1875550140431744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664167.237704:0:10409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664167.237714:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664167.237717:0:10409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788664167.237722:0:10409:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c42f78b000 00000020:00000080:2.0:1788664167.237725:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788664167.238024:0:10409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10409:1875550140431872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.238766:0:10409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.239552:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140431872 00000100:00100000:2.0:1788664167.239560:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140431872 00000100:00100000:2.0:1788664167.239608:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788664167.239617:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:10409:x1875550140431872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.239750:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+17:10409:x1875550140431872:12345-0@lo:502:llog_process_th.0 Request processed in 134us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.239758:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788664167.242955:0:10409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.243006:0:10409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10409:1875550140431872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664167.243047:0:10409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664167.243179:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664167.243182:0:10409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788664167.243187:0:10409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788664167.243279:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788664167.243305:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788664167.243315:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d7aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.243326:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d7aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664167.243336:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788664167.243339:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c42d99f800 from 48 10000000:01000000:3.0:1788664167.243342:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788664167.243374:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.243382:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.243391:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664167.243424:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140432000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.243501:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.243545:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.250562:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140432000 00000100:00100000:2.0:1788664167.250574:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140432000 00000100:00100000:2.0:1788664167.250633:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788664167.250651:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+17:6508:x1875550140432000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664167.250670:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664167.250687:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c400030c00/0xcd11f61c1413d7bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d7b8 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.250715:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c400030c00/0xcd11f61c1413d7bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d7b8 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.250727:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c400030c00/0xcd11f61c1413d7bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d7b8 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.250737:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400030c00, rc 0) 00000100:00100000:2.0:1788664167.250844:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140432000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (7355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.250852:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788664167.250924:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140432000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664167.250941:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.250952:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d7bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664167.251042:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140432128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.251226:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.251246:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.251258:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140432128 00000100:00100000:2.0:1788664167.251262:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140432128 00000100:00100000:2.0:1788664167.251283:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788664167.251295:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140432128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.251399:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140432128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.251406:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788664167.251433:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140432128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.251458:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140432256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.251513:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.251525:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.251537:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140432256 00000100:00100000:2.0:1788664167.251540:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140432256 00000100:00100000:2.0:1788664167.251562:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788664167.251568:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140432256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.251646:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140432256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.251653:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788664167.251727:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140432256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.253203:0:10412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10412:1875550140432384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.253267:0:10412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.253310:0:10412:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.253326:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140432384 00000100:00100000:3.0:1788664167.253332:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140432384 00000100:00100000:3.0:1788664167.253374:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788664167.253382:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:10412:x1875550140432384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664167.253514:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:10412:x1875550140432384:12345-0@lo:502:llog_process_th.0 Request processed in 132us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.253523:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788664167.253549:0:10412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10412:1875550140432384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.253589:0:10412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10412:1875550140432512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.253620:0:10412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.253641:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140432512 00000100:00100000:2.0:1788664167.253650:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140432512 00000100:00100000:2.0:1788664167.253671:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788664167.253678:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+18:10412:x1875550140432512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.253737:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+18:10412:x1875550140432512:12345-0@lo:502:llog_process_th.0 Request processed in 59us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.253744:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788664167.253795:0:10412:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.253823:0:10412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10412:1875550140432512:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788664167.253841:0:10412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788664167.254066:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788664167.254090:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788664167.254100:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.254111:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664167.254121:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788664167.254124:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1788664167.254127:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788664167.254150:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.254159:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.254168:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664167.254181:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140432640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.254215:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.254243:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.254937:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140432640 00000100:00100000:2.0:1788664167.254944:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140432640 00000100:00100000:2.0:1788664167.254977:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788664167.254985:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+18:6508:x1875550140432640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664167.255007:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664167.255021:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d7cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d7c6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.255045:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d7cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d7c6 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.255068:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d7cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d7c6 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.255077:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c800, rc 0) 00000100:00100000:2.0:1788664167.255118:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+19:6508:x1875550140432640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.255126:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788664167.255160:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140432640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664167.255181:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.255190:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d7cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664167.255242:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140432768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.255271:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.255284:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140432768 00000100:00100000:3.0:1788664167.255288:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140432768 00000100:00100000:2.0:1788664167.255288:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.255795:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788664167.255805:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+19:6508:x1875550140432768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.255920:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+19:6508:x1875550140432768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.256905:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788664167.256976:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140432768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.257032:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140432896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.257214:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.257245:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.257260:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140432896 00000100:00100000:2.0:1788664167.257266:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140432896 00000100:00100000:2.0:1788664167.257293:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788664167.257299:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+19:6508:x1875550140432896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.257394:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+19:6508:x1875550140432896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.257402:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788664167.257475:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140432896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.258208:0:10413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10413:1875550140433024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.258252:0:10413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.258284:0:10413:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.258674:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140433024 00000100:00100000:3.0:1788664167.258681:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140433024 00000100:00100000:3.0:1788664167.258716:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788664167.258724:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+19:10413:x1875550140433024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664167.258870:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+19:10413:x1875550140433024:12345-0@lo:502:llog_process_th.0 Request processed in 146us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.258878:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788664167.259842:0:10413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10413:1875550140433024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664167.259880:0:10413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664167.259891:0:10413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664167.259893:0:10413:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788664167.259901:0:10413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788664167.261191:0:10413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10413:1875550140433152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664167.261271:0:10413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.261319:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140433152 00000100:00100000:3.0:1788664167.261326:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140433152 00000100:00100000:3.0:1788664167.261366:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788664167.261374:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+19:10413:x1875550140433152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664167.261502:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+19:10413:x1875550140433152:12345-0@lo:502:llog_process_th.0 Request processed in 115us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.261510:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788664167.261919:0:10413:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.261947:0:10413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10413:1875550140433152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664167.261976:0:10413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664167.261983:0:10413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664167.261986:0:10413:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788664167.261990:0:10413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1788664167.262093:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1788664167.262113:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788664167.262124:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.262135:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664167.262146:0:6508:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:3.0:1788664167.262149:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c42d99f800 from 4 10000000:01000000:3.0:1788664167.262152:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788664167.262182:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351efe00/0xcd11f61c1413d7d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.262190:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4351efe00/0xcd11f61c1413d7d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.262200:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4351efe00/0xcd11f61c1413d7d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664167.262217:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140433280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.262262:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.264215:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.264245:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140433280 00000100:00100000:3.0:1788664167.264254:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140433280 00000100:00100000:3.0:1788664167.264322:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788664167.264332:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+19:6508:x1875550140433280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664167.264349:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664167.264367:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4351eec00/0xcd11f61c1413d7db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d7d4 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.264394:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4351eec00/0xcd11f61c1413d7db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d7d4 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.264406:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4351eec00/0xcd11f61c1413d7db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d7d4 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.264416:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351eec00, rc 0) 00000100:00100000:3.0:1788664167.264486:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140433280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.264504:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788664167.265186:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140433280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664167.265208:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4351efe00/0xcd11f61c1413d7d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.265220:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4351efe00/0xcd11f61c1413d7d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d7db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664167.265658:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140433408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.265882:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.265923:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.266485:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140433408 00000100:00100000:0.0:1788664167.266503:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140433408 00000100:00100000:0.0:1788664167.266558:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788664167.266712:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140433408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664167.266861:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140433408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.266869:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788664167.267014:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140433408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.267054:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140433536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.267094:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.267226:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.268068:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140433536 00000100:00100000:0.0:1788664167.268077:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140433536 00000100:00100000:0.0:1788664167.268154:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788664167.268164:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140433536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664167.268290:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140433536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.268310:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788664167.271758:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140433536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.272332:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10414:1875550140433664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.272405:0:10414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.281194:0:10414:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f791480 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.284048:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140433664 00000100:00100000:3.0:1788664167.284063:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140433664 00000100:00100000:3.0:1788664167.284113:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788664167.284122:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+20:10414:x1875550140433664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664167.284296:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+20:10414:x1875550140433664:12345-0@lo:502:llog_process_th.0 Request processed in 174us (11891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.284307:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788664167.284412:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10414:1875550140433664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664167.284448:0:10414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664167.284457:0:10414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664167.284459:0:10414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788664167.284467:0:10414:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c42d99f800 00000020:00000080:3.0:1788664167.284469:0:10414:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788664167.284586:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10414:1875550140433792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664167.284631:0:10414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.284659:0:10414:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.284673:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140433792 00000100:00100000:3.0:1788664167.284676:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140433792 00000100:00100000:3.0:1788664167.284696:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788664167.284702:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+20:10414:x1875550140433792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664167.284766:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+20:10414:x1875550140433792:12345-0@lo:502:llog_process_th.0 Request processed in 63us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.284795:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788664167.284837:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10414:1875550140433792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664167.284855:0:10414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664167.284859:0:10414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664167.284861:0:10414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788664167.284865:0:10414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788664167.285123:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788664167.285144:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788664167.285155:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351efe00/0xcd11f61c1413d7d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.285167:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4351efe00/0xcd11f61c1413d7d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664167.285175:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788664167.285178:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c40641a800 from 48 10000000:01000000:2.0:1788664167.285181:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788664167.285205:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.285213:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.285222:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664167.285235:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140433920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.285264:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.285292:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f791480 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.285810:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140433920 00000100:00100000:3.0:1788664167.285816:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140433920 00000100:00100000:3.0:1788664167.285842:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788664167.285849:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140433920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664167.285860:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664167.285874:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4351ef600/0xcd11f61c1413d7e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d7e2 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.285897:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4351ef600/0xcd11f61c1413d7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d7e2 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.285907:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4351ef600/0xcd11f61c1413d7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d7e2 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.285915:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351ef600, rc 0) 00000100:00100000:3.0:1788664167.285968:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140433920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.285975:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788664167.286012:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140433920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664167.286035:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.286045:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d7e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664167.286101:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140434048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.286130:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.286150:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.286162:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140434048 00000100:00100000:3.0:1788664167.286165:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140434048 00000100:00100000:3.0:1788664167.286181:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788664167.286187:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140434048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.286288:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140434048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.286295:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788664167.286321:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140434048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.286347:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140434176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.286385:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.286399:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.286409:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140434176 00000100:00100000:3.0:1788664167.286413:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140434176 00000100:00100000:3.0:1788664167.286430:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788664167.286436:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140434176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.286530:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140434176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.286546:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788664167.287038:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140434176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.288916:0:10416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10416:1875550140434304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664167.292854:0:10416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.292903:0:10416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.295052:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140434304 00000100:00100000:0.0:1788664167.295067:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140434304 00000100:00100000:0.0:1788664167.295121:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788664167.295132:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+21:10416:x1875550140434304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664167.295295:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+21:10416:x1875550140434304:12345-0@lo:502:llog_process_th.0 Request processed in 164us (2446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.295304:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788664167.295581:0:10416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10416:1875550140434304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664167.295647:0:10416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10416:1875550140434432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664167.295689:0:10416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.295723:0:10416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.296005:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140434432 00000100:00100000:0.0:1788664167.296010:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140434432 00000100:00100000:0.0:1788664167.296040:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788664167.296048:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+21:10416:x1875550140434432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664167.296117:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+21:10416:x1875550140434432:12345-0@lo:502:llog_process_th.0 Request processed in 69us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.296130:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788664167.296212:0:10416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10416:1875550140434432:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788664167.296231:0:10416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788664167.296369:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788664167.296392:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788664167.296401:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.296412:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664167.296422:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788664167.296425:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1788664167.296427:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788664167.296450:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.296459:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.296468:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.296482:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140434560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788664167.296524:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.296544:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6780 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.296688:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140434560 00000100:00100000:0.0:1788664167.296693:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140434560 00000100:00100000:0.0:1788664167.296717:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788664167.296723:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140434560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664167.296733:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664167.296751:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40153a800/0xcd11f61c1413d7f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d7f0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.296793:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40153a800/0xcd11f61c1413d7f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d7f0 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.296804:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40153a800/0xcd11f61c1413d7f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d7f0 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.296813:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40153a800, rc 0) 00000100:00100000:0.0:1788664167.296843:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140434560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.296849:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788664167.296873:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140434560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664167.296884:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.296893:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d7f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.297857:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140434688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664167.297902:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.297915:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6780 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.297953:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140434688 00000100:00100000:0.0:1788664167.297958:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140434688 00000100:00100000:0.0:1788664167.297984:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788664167.297990:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140434688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664167.298101:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140434688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.298118:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788664167.298146:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140434688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664167.298176:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140434816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664167.298213:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.298221:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6780 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.298235:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140434816 00000100:00100000:0.0:1788664167.298239:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140434816 00000100:00100000:0.0:1788664167.298256:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788664167.298261:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140434816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664167.298359:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140434816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.298366:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788664167.298403:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140434816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664167.308443:0:10418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10418:1875550140434944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664167.308537:0:10418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.308578:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140434944 00000100:00100000:1.0:1788664167.308585:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140434944 00000100:00100000:1.0:1788664167.308625:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788664167.308634:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:10418:x1875550140434944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664167.308755:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:10418:x1875550140434944:12345-0@lo:502:llog_process_th.0 Request processed in 121us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.308762:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788664167.308869:0:10418:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3037116c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.308892:0:10418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10418:1875550140434944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788664167.308920:0:10418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664167.308929:0:10418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664167.308932:0:10418:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788664167.308939:0:10418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788664167.308960:0:10418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10418:1875550140435072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664167.309006:0:10418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.309025:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140435072 00000100:00100000:1.0:1788664167.309030:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140435072 00000100:00100000:1.0:1788664167.309046:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788664167.309064:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:10418:x1875550140435072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664167.309122:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:10418:x1875550140435072:12345-0@lo:502:llog_process_th.0 Request processed in 58us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.309135:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788664167.309161:0:10418:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3037116c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.309173:0:10418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10418:1875550140435072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788664167.309190:0:10418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664167.309194:0:10418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664167.309195:0:10418:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788664167.309199:0:10418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788664167.309250:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788664167.309270:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788664167.309279:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.309290:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664167.309300:0:6508:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788664167.309304:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c40641a800 from 4 10000000:01000000:1.0:1788664167.309307:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664167.309331:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d7fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.309339:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d7fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.309349:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d7fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664167.309362:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140435200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788664167.309388:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.309412:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3037116c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.309422:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140435200 00000100:00100000:1.0:1788664167.309425:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140435200 00000100:00100000:1.0:1788664167.309443:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788664167.309448:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140435200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664167.309456:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664167.309468:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413d805 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d7fe expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.309487:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413d805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d7fe expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.309511:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413d805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d7fe expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.309521:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e3200, rc 0) 00000100:00100000:1.0:1788664167.309557:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140435200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.309564:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788664167.309816:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140435200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664167.309829:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d7fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d805 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.309839:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d7fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d805 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664167.309895:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140435328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.309922:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.310393:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9240 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.310833:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140435328 00000100:00100000:1.0:1788664167.310841:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140435328 00000100:00100000:1.0:1788664167.310883:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788664167.310892:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140435328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664167.311033:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140435328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.311041:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788664167.311234:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140435328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664167.311274:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140435456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664167.311323:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.311339:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c30396de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.311354:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140435456 00000100:00100000:1.0:1788664167.311358:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140435456 00000100:00100000:1.0:1788664167.311379:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788664167.311386:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140435456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664167.311464:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140435456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.311471:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788664167.311554:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140435456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.312284:0:10421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10421:1875550140435584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.312345:0:10421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.312383:0:10421:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f791e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.312566:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140435584 00000100:00100000:1.0:1788664167.312572:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140435584 00000100:00100000:1.0:1788664167.312612:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788664167.312621:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+23:10421:x1875550140435584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664167.312718:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+23:10421:x1875550140435584:12345-0@lo:502:llog_process_th.0 Request processed in 97us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.312725:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788664167.313030:0:10421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10421:1875550140435584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664167.313126:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664167.313138:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664167.313140:0:10421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788664167.313148:0:10421:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c40641a800 00000020:00000080:2.0:1788664167.313150:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788664167.313245:0:10421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10421:1875550140435712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.313285:0:10421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.313308:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140435712 00000100:00100000:2.0:1788664167.313312:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140435712 00000100:00100000:2.0:1788664167.313337:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788664167.313344:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+23:10421:x1875550140435712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664167.313443:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+23:10421:x1875550140435712:12345-0@lo:502:llog_process_th.0 Request processed in 98us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.313450:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788664167.313499:0:10421:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f791e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.313511:0:10421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:10421:1875550140435712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664167.313526:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664167.313530:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664167.313532:0:10421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788664167.313535:0:10421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788664167.314421:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788664167.314450:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788664167.314460:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d7fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d805 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.314479:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d7fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d805 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664167.314500:0:6508:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788664167.314502:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff93c422744d40 from 1 10000000:01000000:3.0:1788664167.314506:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788664167.314537:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d80c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.314546:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d80c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.317288:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d80c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664167.317318:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140435840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664167.317382:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.317434:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.317534:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140435840 00000100:00100000:1.0:1788664167.317543:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140435840 00000100:00100000:1.0:1788664167.317594:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788664167.317604:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140435840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664167.317621:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664167.317638:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4029e3600/0xcd11f61c1413d813 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d80c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.317664:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e3600/0xcd11f61c1413d813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d80c expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.317684:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4029e3600/0xcd11f61c1413d813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d80c expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.317693:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e3600, rc 0) 00000100:00100000:1.0:1788664167.317737:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140435840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.317744:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788664167.322955:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140435840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664167.322985:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d80c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.323010:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d80c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664167.323168:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140435968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.323226:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.323261:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43cf8bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.323280:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140435968 00000100:00100000:2.0:1788664167.323285:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140435968 00000100:00100000:2.0:1788664167.323335:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788664167.323344:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140435968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664167.323440:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140435968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (213us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788664167.323448:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788664167.323460:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140435968:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788664167.323524:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788664167.323532:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d80c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.323541:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d80c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664167.486209:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140436352:0@lo:400:kworker.0 00000100:00100000:1.0:1788664167.486283:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.486339:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140436864:0@lo:400:kworker.0 00000100:00100000:1.0:1788664167.486378:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.486404:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140437376:0@lo:400:kworker.0 00000100:00100000:1.0:1788664167.486427:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.486456:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788664167.486462:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140436224:0@lo:400:kworker.0 00000100:00100000:1.0:1788664167.486503:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.486522:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140436736:0@lo:400:kworker.0 00000100:00100000:1.0:1788664167.486546:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.486569:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140437248:0@lo:400:kworker.0 00000100:00100000:1.0:1788664167.486591:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.486625:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140436864 00000100:00100000:1.0:1788664167.486632:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140436864 00000100:00100000:1.0:1788664167.486679:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140437376 00000100:00100000:1.0:1788664167.486683:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140437376 00000100:00100000:1.0:1788664167.486697:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140436736 00000100:00100000:1.0:1788664167.486713:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140436736 00000100:00100000:1.0:1788664167.486732:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140437248 00000100:00100000:1.0:1788664167.486734:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140437248 00000100:00100000:1.0:1788664167.486751:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788664167.486759:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140436864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664167.486842:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140436864:12345-0@lo:400:kworker.0 Request processed in 83us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.486849:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788664167.486867:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788664167.486873:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140437376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664167.486901:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140437376:12345-0@lo:400:kworker.0 Request processed in 28us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.486907:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788664167.486919:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788664167.486924:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140436736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664167.486948:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140436736:12345-0@lo:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.486954:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788664167.486963:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788664167.486969:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140437248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664167.486993:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140437248:12345-0@lo:400:kworker.0 Request processed in 25us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.486999:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788664167.487020:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140436224 00000100:00100000:1.0:1788664167.487024:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140436224 00000100:00100000:1.0:1788664167.487048:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788664167.487054:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140436224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664167.487093:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140436224:12345-0@lo:400:kworker.0 Request processed in 39us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.487100:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788664167.487124:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664167.487129:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664167.487157:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140436224:0@lo:400:kworker.0 00010000:00080000:1.0:1788664167.487172:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303ab8700 x1875550140436736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664167.487183:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140436736:0@lo:400:kworker.0 00010000:00080000:1.0:1788664167.487193:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303aba680 x1875550140437248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664167.487202:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140437248:0@lo:400:kworker.0 00010000:00080000:1.0:1788664167.487211:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303ab9500 x1875550140436864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664167.487220:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140436864:0@lo:400:kworker.0 00010000:00080000:1.0:1788664167.487230:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abb800 x1875550140437376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664167.487238:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140437376:0@lo:400:kworker.0 00000100:00100000:2.0:1788664167.487566:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140436096:0@lo:400:kworker.0 00000100:00100000:2.0:1788664167.487604:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.487636:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140436608:0@lo:400:kworker.0 00000100:00100000:2.0:1788664167.487658:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.487683:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140437120:0@lo:400:kworker.0 00000100:00100000:2.0:1788664167.487703:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.487720:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788664167.487727:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140436480:0@lo:400:kworker.0 00000100:00100000:2.0:1788664167.487748:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.487765:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140436992:0@lo:400:kworker.0 00000100:00100000:2.0:1788664167.487815:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.487843:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140436352 00000100:00100000:2.0:1788664167.487848:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140436352 00000100:00100000:2.0:1788664167.487870:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140436096 00000100:00100000:2.0:1788664167.487881:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140436096 00000100:00100000:2.0:1788664167.487896:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140436608 00000100:00100000:2.0:1788664167.487898:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140436608 00000100:00100000:2.0:1788664167.487917:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140437120 00000100:00100000:2.0:1788664167.487919:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140437120 00000100:00100000:2.0:1788664167.487929:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140436480 00000100:00100000:2.0:1788664167.487931:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140436480 00000100:00100000:2.0:1788664167.487941:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140436992 00000100:00100000:2.0:1788664167.487943:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140436992 00000100:00100000:2.0:1788664167.487957:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788664167.487962:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140436352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664167.488003:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140436352:12345-0@lo:400:kworker.0 Request processed in 40us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.488009:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788664167.488022:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788664167.488027:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140436096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664167.488070:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140436096:12345-0@lo:400:kworker.0 Request processed in 43us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.488076:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788664167.488087:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788664167.488093:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140436608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664167.488119:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140436608:12345-0@lo:400:kworker.0 Request processed in 27us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.488125:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788664167.488136:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788664167.488142:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140437120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664167.488169:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140437120:12345-0@lo:400:kworker.0 Request processed in 27us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.488183:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788664167.488194:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788664167.488200:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140436480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664167.488228:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140436480:12345-0@lo:400:kworker.0 Request processed in 29us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.488233:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788664167.488242:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788664167.488248:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140436992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664167.488269:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140436992:12345-0@lo:400:kworker.0 Request processed in 22us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.488274:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788664167.488288:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664167.488291:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664167.488310:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140436480:0@lo:400:kworker.0 00000100:00100000:2.0:1788664167.488319:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140436992:0@lo:400:kworker.0 00000100:00100000:2.0:1788664167.488327:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140436096:0@lo:400:kworker.0 00010000:00080000:2.0:1788664167.488336:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303ab8000 x1875550140436608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664167.488345:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140436608:0@lo:400:kworker.0 00010000:00080000:2.0:1788664167.488352:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abad80 x1875550140437120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664167.488537:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140436352:0@lo:400:kworker.0 00000100:00100000:2.0:1788664167.488606:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140437120:0@lo:400:kworker.0 00000100:00100000:3.0:1788664167.488859:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664167.488869:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140437504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664167.488905:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.490473:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140437504 00000100:00100000:2.0:1788664167.490507:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140437504 00000100:00100000:2.0:1788664167.490562:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788664167.490570:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140437504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664167.490600:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664167.490678:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140437504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.490685:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788664167.490812:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abc700 x1875550140437504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664167.490832:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140437504:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788664167.869891:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664167.999079:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140437632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788664167.999150:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.999276:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140437632 00000100:00100000:2.0:1788664167.999284:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140437632 00000100:00100000:2.0:1788664167.999401:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788664167.999410:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140437632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788664167.999433:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664168.005443:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140437632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6024us (6282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664168.005456:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788664168.009266:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303adfb80 x1875550140437632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664168.009304:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140437632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788664168.511400:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140437760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788664168.511471:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664168.511623:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140437760 00000100:00100000:0.0:1788664168.511631:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140437760 00000100:00100000:0.0:1788664168.511684:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788664168.511694:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140437760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788664168.511739:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788664168.511815:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140437760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664168.511822:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788664168.512030:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140437760:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788664168.909368:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664169.021959:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664169.024410:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664169.024433:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140438016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664169.024514:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664169.024795:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140438016 00000100:00100000:2.0:1788664169.024803:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140438016 00000100:00100000:2.0:1788664169.024865:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788664169.024875:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140438016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664169.024905:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664169.024953:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140438016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664169.024959:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788664169.025084:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788664169.025129:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abd880 x1875550140438016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664169.025147:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140438016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664169.026493:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140437888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664169.026552:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664169.026704:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140437888 00000100:00100000:0.0:1788664169.026711:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140437888 00000100:00100000:0.0:1788664169.026833:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788664169.026855:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140437888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788664169.026878:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664169.026935:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140437888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664169.026943:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788664169.027095:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abd500 x1875550140437888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664169.027113:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140437888:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788664169.027224:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788664169.918124:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664170.137815:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664170.137845:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664170.137870:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664170.137888:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664170.137911:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664170.138023:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119403008 00000100:00100000:3.0:1788664170.138032:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119403008 00000100:00100000:3.0:1788664170.138097:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119402880 00000100:00100000:3.0:1788664170.138113:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119402880 00000100:00100000:3.0:1788664170.138143:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:3.0:1788664170.138153:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119403008:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664170.138639:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119403008:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 487us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664170.138648:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:3.0:1788664170.138667:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:3.0:1788664170.138674:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119402880:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664170.138699:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119402880:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664170.138705:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:1.0:1788664170.139724:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119402752 00000100:00100000:1.0:1788664170.139733:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119402752 00000100:00100000:1.0:1788664170.139793:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 275 00000100:00100000:1.0:1788664170.139803:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2392:x1875550119402752:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664170.139850:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2392:x1875550119402752:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 49us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664170.139857:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 275 00000100:00100000:1.0:1788664170.139888:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119403264 00000100:00100000:1.0:1788664170.139892:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119403264 00000100:00100000:1.0:1788664170.139917:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119403136 00000100:00100000:1.0:1788664170.139920:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119403136 00000100:00100000:1.0:1788664170.139940:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1788664170.139947:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119403264:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664170.139973:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119403264:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664170.139979:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1788664170.139989:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:1.0:1788664170.139995:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119403136:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664170.140015:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119403136:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 21us (2104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664170.140022:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00080000:0.0:1788664170.141768:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788664170.141798:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664170.141801:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664170.141803:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788664170.941889:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664171.970406:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664172.100857:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140438144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664172.100924:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664172.100987:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140438144 00000100:00100000:2.0:1788664172.100999:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140438144 00000100:00100000:2.0:1788664172.101043:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788664172.101052:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140438144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788664172.101085:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788664172.101129:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140438144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664172.101136:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788664172.101177:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140438144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664172.606088:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140438400:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.606154:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664172.606209:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140438912:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.606231:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664172.606255:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140439424:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.606290:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664172.606320:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788664172.606327:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140438272:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.606354:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664172.606373:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140438784:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.606394:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664172.606419:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140439296:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.606446:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664172.606487:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140438528:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.606527:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664172.606643:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140438272 00000100:00100000:2.0:1788664172.606653:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140438272 00000100:00100000:2.0:1788664172.606700:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788664172.606721:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140438272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664172.606808:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140438272:12345-0@lo:400:kworker.0 Request processed in 89us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664172.606815:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788664172.610020:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140439040:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.610081:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664172.610103:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140439552:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.610125:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664172.610150:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788664172.610158:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140438656:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.610185:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664172.610200:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140439168:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.610220:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664172.610239:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140439680:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.610257:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664172.610298:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140438400 00000100:00100000:0.0:1788664172.610306:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140438400 00000100:00100000:0.0:1788664172.610343:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140438912 00000100:00100000:0.0:1788664172.610346:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140438912 00000100:00100000:0.0:1788664172.610367:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140439424 00000100:00100000:0.0:1788664172.610370:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140439424 00000100:00100000:0.0:1788664172.610383:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140438784 00000100:00100000:0.0:1788664172.610386:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140438784 00000100:00100000:0.0:1788664172.610398:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140439296 00000100:00100000:0.0:1788664172.610401:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140439296 00000100:00100000:0.0:1788664172.610413:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140438656 00000100:00100000:0.0:1788664172.610416:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140438656 00000100:00100000:0.0:1788664172.610429:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788664172.610446:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140438400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.610508:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140438400:12345-0@lo:400:kworker.0 Request processed in 65us (4355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664172.610515:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788664172.611563:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140439808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664172.611608:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664172.612099:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788664172.612112:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140438912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.612164:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140438912:12345-0@lo:400:kworker.0 Request processed in 57us (5932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664172.612171:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788664172.612184:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788664172.612191:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140439424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.612219:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140439424:12345-0@lo:400:kworker.0 Request processed in 29us (5928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664172.612225:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788664172.612237:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788664172.612245:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140438784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.612271:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140438784:12345-0@lo:400:kworker.0 Request processed in 29us (5877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664172.612278:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788664172.612289:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788664172.612295:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140439296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.612323:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140439296:12345-0@lo:400:kworker.0 Request processed in 28us (5876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664172.612328:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788664172.612340:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788664172.612353:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140438656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.612389:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140438656:12345-0@lo:400:kworker.0 Request processed in 37us (2203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664172.612395:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788664172.612429:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140438528 00000100:00100000:0.0:1788664172.612436:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140438528 00000100:00100000:0.0:1788664172.612476:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788664172.612482:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140438528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.612515:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140438528:12345-0@lo:400:kworker.0 Request processed in 33us (5988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664172.612521:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788664172.613661:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140439040 00000100:00100000:2.0:1788664172.614126:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140438656:0@lo:400:kworker.0 00000100:00100000:2.0:1788664172.614143:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140438528:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.614636:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140439040 00000100:00100000:0.0:1788664172.614698:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140439552 00000100:00100000:0.0:1788664172.615471:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140439552 00000100:00100000:0.0:1788664172.615506:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140439168 00000100:00100000:0.0:1788664172.615512:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140439168 00000100:00100000:0.0:1788664172.615528:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140439680 00000100:00100000:0.0:1788664172.615531:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140439680 00000100:00100000:0.0:1788664172.615789:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788664172.615801:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140439040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.615898:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140439040:12345-0@lo:400:kworker.0 Request processed in 100us (5816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664172.615906:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788664172.615926:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788664172.615932:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140439552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.615963:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140439552:12345-0@lo:400:kworker.0 Request processed in 32us (5837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664172.615980:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788664172.615992:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788664172.615999:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140439168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.616031:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140439168:12345-0@lo:400:kworker.0 Request processed in 33us (5810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664172.616037:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788664172.616048:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788664172.616055:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140439680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.616085:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140439680:12345-0@lo:400:kworker.0 Request processed in 31us (5826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664172.616092:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788664172.616115:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788664172.616116:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140438272:0@lo:400:kworker.0 00000100:00080000:0.0:1788664172.616119:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788664172.616124:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664172.616128:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788664172.616139:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140438784:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.616140:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140439808 00000100:00100000:0.0:1788664172.616146:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140439808 00000100:00100000:1.0:1788664172.616156:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140439296:0@lo:400:kworker.0 00000100:00100000:1.0:1788664172.616175:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140438400:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.616176:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788664172.616187:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140439808:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788664172.616197:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303addc00 x1875550140438912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1788664172.616211:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664172.616225:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140438912:0@lo:400:kworker.0 00010000:00080000:1.0:1788664172.616240:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303adfb80 x1875550140439424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664172.616252:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140439424:0@lo:400:kworker.0 00000100:00100000:0.0:1788664172.616253:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140439808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (4642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664172.616264:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788664172.616765:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abed80 x1875550140439808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664172.616803:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140439808:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788664172.616832:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303adf800 x1875550140439168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664172.616858:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140439168:0@lo:400:kworker.0 00010000:00080000:2.0:1788664172.616872:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303ade300 x1875550140439680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664172.616880:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140439680:0@lo:400:kworker.0 00010000:00080000:2.0:1788664172.616891:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303adea00 x1875550140439040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664172.616899:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140439040:0@lo:400:kworker.0 00010000:00080000:2.0:1788664172.616911:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303adc380 x1875550140439552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664172.616920:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140439552:0@lo:400:kworker.0 00010000:00010000:3.0:1788664172.993034:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664173.124571:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140439936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664173.124648:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664173.124731:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140439936 00000100:00100000:0.0:1788664173.124753:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140439936 00000100:00100000:0.0:1788664173.124817:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788664173.124826:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140439936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664173.124847:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664173.124886:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140439936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664173.124893:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788664173.124931:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039d5500 x1875550140439936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664173.124950:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140439936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664173.633962:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140440064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788664173.634032:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664173.634305:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140440064 00000100:00100000:0.0:1788664173.634313:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140440064 00000100:00100000:0.0:1788664173.634364:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788664173.634373:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140440064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788664173.634406:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788664173.634470:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140440064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664173.634477:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788664173.634550:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140440064:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1788664173.777035:0:10690:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788664174.014314:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664174.141905:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664174.141927:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140440192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664174.141990:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664174.142051:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140440192 00000100:00100000:3.0:1788664174.142058:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140440192 00000100:00100000:3.0:1788664174.142104:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788664174.142114:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140440192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788664174.142153:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664174.142198:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140440192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664174.142205:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788664174.142228:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788664174.142258:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a08a80 x1875550140440192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664174.142293:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140440192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788664174.144510:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664174.144530:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140440320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664174.144595:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664174.144696:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140440320 00000100:00100000:3.0:1788664174.144703:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140440320 00000100:00100000:3.0:1788664174.144767:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788664174.144800:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140440320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788664174.144821:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664174.144867:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140440320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664174.144875:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788664174.144960:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a08a80 x1875550140440320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664174.144976:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140440320:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788664174.145032:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788664175.045854:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664175.264655:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664175.264743:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664175.264806:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664175.264851:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119403392 00000100:00100000:3.0:1788664175.264861:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119403392 00000100:00100000:3.0:1788664175.264905:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 277 00000100:00100000:3.0:1788664175.264914:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2390:x1875550119403392:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664175.264985:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2390:x1875550119403392:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 72us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664175.264993:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 277 00000100:00100000:1.0:1788664175.270198:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119403520 00000100:00100000:1.0:1788664175.270211:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119403520 00000100:00100000:1.0:1788664175.270622:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119403648 00000100:00100000:1.0:1788664175.270627:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119403648 00000100:00080000:2.0:1788664175.270654:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788664175.270659:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664175.270701:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:2.0:1788664175.270715:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119403520:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664175.270838:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119403520:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 126us (6190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664175.270847:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:3.0:1788664175.271074:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664175.271109:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:3.0:1788664175.271110:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664175.271122:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119403648:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664175.271144:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119403904 00000100:00100000:3.0:1788664175.271149:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119403904 00000100:00100000:1.0:1788664175.271178:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119403648:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 59us (6405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664175.271185:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:1.0:1788664175.271205:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119403776 00000100:00100000:1.0:1788664175.271208:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119403776 00000100:00100000:1.0:1788664175.271231:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1788664175.271237:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119403776:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664175.271260:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119403776:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664175.271266:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00080000:2.0:1788664175.271386:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664175.271395:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664175.271985:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:3.0:1788664175.271996:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43ced8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119403904:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664175.272042:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43ced8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119403904:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 50us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664175.272059:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00010000:00010000:3.0:1788664176.063831:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664177.090547:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664177.219764:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140440448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664177.219897:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664177.220006:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140440448 00000100:00100000:0.0:1788664177.220013:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140440448 00000100:00100000:0.0:1788664177.220062:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788664177.220071:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140440448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788664177.220118:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788664177.225954:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140440448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5872us (6045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664177.225967:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788664177.237537:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140440448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664177.726399:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664177.726995:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140440576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664177.727131:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664177.727196:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140440576 00000100:00100000:2.0:1788664177.727203:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140440576 00000100:00100000:2.0:1788664177.727324:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788664177.727334:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140440576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664177.727363:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664177.727406:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140440576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664177.727413:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788664177.728002:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788664177.728518:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abca80 x1875550140440576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664177.728539:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140440576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664177.728561:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140440704:0@lo:400:kworker.0 00000100:00100000:2.0:1788664177.728603:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664177.728628:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140441216:0@lo:400:kworker.0 00000100:00100000:2.0:1788664177.728649:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664177.728663:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140441728:0@lo:400:kworker.0 00000100:00100000:2.0:1788664177.728678:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664177.728692:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788664177.728697:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140441088:0@lo:400:kworker.0 00000100:00100000:2.0:1788664177.728714:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664177.728726:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140441600:0@lo:400:kworker.0 00000100:00100000:2.0:1788664177.728756:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664177.728801:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140440704 00000100:00100000:2.0:1788664177.728806:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140440704 00000100:00100000:2.0:1788664177.728889:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788664177.728898:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140440704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664177.732264:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140441216 00000100:00100000:3.0:1788664177.732279:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140441216 00000100:00100000:3.0:1788664177.732350:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140441728 00000100:00100000:3.0:1788664177.732354:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140441728 00000100:00100000:3.0:1788664177.732379:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140441088 00000100:00100000:3.0:1788664177.732382:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140441088 00000100:00100000:3.0:1788664177.732398:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788664177.732407:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140441216:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788664177.732541:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664177.732555:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140441600 00000100:00100000:2.0:1788664177.732559:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140441600 00000100:00100000:2.0:1788664177.732590:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788664177.732597:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140441600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664177.732668:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140441600:12345-0@lo:400:kworker.0 Request processed in 72us (3910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664177.732675:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788664177.732698:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788664177.732727:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039d4000 x1875550140441600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664177.732746:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140441600:0@lo:400:kworker.0 00000100:00100000:2.0:1788664177.732800:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140440704:12345-0@lo:400:kworker.0 Request processed in 3904us (4197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664177.732800:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788664177.732808:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788664177.732808:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140441728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664177.732832:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140440704:0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.732841:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140441728:12345-0@lo:400:kworker.0 Request processed in 36us (4162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664177.732844:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140441728:0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.732847:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788664177.732860:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788664177.733217:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140441088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.733334:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140441088:12345-0@lo:400:kworker.0 Request processed in 468us (4618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664177.733341:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788664177.733372:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140440832:0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.733404:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664177.733442:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140441344:0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.733463:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664177.733474:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140441856:0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.733494:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664177.733507:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788664177.733514:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140440960:0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.733538:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664177.733557:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140441472:0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.733594:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664177.733613:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140441984:0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.733632:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664177.733662:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140440832 00000100:00100000:0.0:1788664177.733667:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140440832 00000100:00100000:0.0:1788664177.733687:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140441344 00000100:00100000:0.0:1788664177.733689:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140441344 00000100:00100000:0.0:1788664177.733706:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140441856 00000100:00100000:0.0:1788664177.733708:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140441856 00000100:00100000:0.0:1788664177.733722:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788664177.733728:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140440832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.733763:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140440832:12345-0@lo:400:kworker.0 Request processed in 34us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664177.733790:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788664177.733803:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788664177.733809:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140441344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.733836:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140441344:12345-0@lo:400:kworker.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664177.733842:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788664177.733853:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788664177.733859:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140441856:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788664177.734041:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664177.734067:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140441088:0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.734347:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140441856:12345-0@lo:400:kworker.0 Request processed in 487us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664177.734354:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788664177.734376:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140440960 00000100:00100000:0.0:1788664177.734380:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140440960 00000100:00100000:0.0:1788664177.734415:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788664177.734443:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140440960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.734474:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140440960:12345-0@lo:400:kworker.0 Request processed in 33us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664177.734480:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788664177.734498:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140441472 00000100:00100000:0.0:1788664177.734502:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140441472 00000100:00100000:0.0:1788664177.734540:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140441984 00000100:00100000:0.0:1788664177.734543:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140441984 00000100:00100000:0.0:1788664177.734566:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788664177.734572:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140441472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.734602:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140441472:12345-0@lo:400:kworker.0 Request processed in 31us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664177.734608:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788664177.734618:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788664177.734623:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140441984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.734649:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140441984:12345-0@lo:400:kworker.0 Request processed in 25us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664177.734654:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788664177.734680:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140440960:0@lo:400:kworker.0 00010000:00080000:0.0:1788664177.734692:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039d4380 x1875550140441472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664177.734702:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140441472:0@lo:400:kworker.0 00010000:00080000:0.0:1788664177.734711:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303743800 x1875550140441984/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664177.734719:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140441984:0@lo:400:kworker.0 00000100:00100000:0.0:1788664177.734737:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140440832:0@lo:400:kworker.0 00010000:00080000:0.0:1788664177.734746:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039d6300 x1875550140441344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664177.734753:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140441344:0@lo:400:kworker.0 00010000:00080000:0.0:1788664177.734762:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039d5500 x1875550140441856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664177.734785:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140441856:0@lo:400:kworker.0 00000100:00080000:0.0:1788664177.734815:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664177.734818:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664177.734965:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140441216:12345-0@lo:400:kworker.0 Request processed in 2558us (6312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664177.734973:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788664177.735009:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140441216:0@lo:400:kworker.0 00010000:00010000:0.0:1788664178.110631:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664178.246095:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664178.246118:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140442112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664178.246667:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664178.246804:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140442112 00000100:00100000:0.0:1788664178.246813:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140442112 00000100:00100000:0.0:1788664178.246869:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788664178.246879:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140442112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664178.246903:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664178.246951:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140442112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664178.246958:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788664178.247162:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303ab8700 x1875550140442112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664178.247180:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140442112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664178.754562:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140442240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788664178.754682:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664178.755185:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140442240 00000100:00100000:3.0:1788664178.755194:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140442240 00000100:00100000:3.0:1788664178.755290:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788664178.755301:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140442240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788664178.755340:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788664178.755486:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140442240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664178.755495:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788664178.755557:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140442240:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788664179.117569:0:10933:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing yml_node 00010000:00010000:2.0:1788664179.139881:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664179.263009:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140442368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664179.263082:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664179.263198:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140442368 00000100:00100000:1.0:1788664179.263206:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140442368 00000100:00100000:1.0:1788664179.263261:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788664179.263270:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140442368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664179.263297:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664179.263339:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140442368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664179.263345:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788664179.263416:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788664179.263445:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303ab8700 x1875550140442368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664179.263464:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140442368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664179.264229:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664179.264243:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140442496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664179.264286:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664179.264328:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140442496 00000100:00100000:0.0:1788664179.264334:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140442496 00000100:00100000:0.0:1788664179.264374:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788664179.264382:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140442496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788664179.264397:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664179.264441:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140442496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664179.264448:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788664179.264464:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788664179.264482:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303740700 x1875550140442496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664179.264498:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140442496:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788664180.161365:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664180.376637:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664180.376677:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664180.376710:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664180.376744:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119404160 00000100:00100000:3.0:1788664180.376753:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119404160 00000100:00100000:3.0:1788664180.376835:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119404288 00000100:00100000:3.0:1788664180.376839:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119404288 00000100:00100000:3.0:1788664180.376860:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:3.0:1788664180.376869:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2390:x1875550119404160:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664180.376959:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2390:x1875550119404160:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 90us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664180.376967:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:3.0:1788664180.376984:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:3.0:1788664180.376991:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119404288:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664180.377019:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119404288:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664180.377025:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00080000:3.0:1788664180.377043:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788664180.377047:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664180.377636:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119404032 00000100:00100000:2.0:1788664180.377645:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119404032 00000100:00100000:2.0:1788664180.377695:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 279 00000100:00100000:2.0:1788664180.377704:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2390:x1875550119404032:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664180.377748:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2390:x1875550119404032:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 46us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664180.377755:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 279 00000100:00100000:3.0:1788664180.380736:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664180.380830:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664180.380902:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119404416 00000100:00100000:2.0:1788664180.380912:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119404416 00000100:00100000:2.0:1788664180.380983:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119404544 00000100:00100000:2.0:1788664180.380987:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119404544 00000100:00100000:2.0:1788664180.381014:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1788664180.381025:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2389:x1875550119404416:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:2.0:1788664180.381065:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d725 00000100:00080000:2.0:1788664180.381076:0:8426:0:(import.c:65:import_set_state_nolock()) ffff93c303733000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788664180.381121:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788664180.381516:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+2:2389:x1875550119404416:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 491us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664180.381524:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1788664180.381540:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1788664180.381547:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2389:x1875550119404544:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:2.0:1788664180.381562:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d72c 00000100:00080000:2.0:1788664180.381580:0:8426:0:(import.c:65:import_set_state_nolock()) ffff93c303732000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788664180.381607:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788664180.381692:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+2:2389:x1875550119404544:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 145us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664180.381700:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00010000:00010000:2.0:1788664180.381809:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664180.381815:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788664180.381958:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788664180.381962:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788664181.181931:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664182.205992:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664182.334569:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140442624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664182.334652:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664182.334820:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140442624 00000100:00100000:2.0:1788664182.334829:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140442624 00000100:00100000:2.0:1788664182.334876:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788664182.334886:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140442624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788664182.334920:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788664182.340547:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140442624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5653us (5884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664182.340563:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788664182.347085:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140442624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664182.846141:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140443008:0@lo:400:kworker.0 00000100:00100000:3.0:1788664182.846209:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664182.846265:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43535ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140443520:0@lo:400:kworker.0 00000100:00100000:3.0:1788664182.846289:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664182.846326:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43535a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140444032:0@lo:400:kworker.0 00000100:00100000:3.0:1788664182.846347:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664182.846373:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788664182.846380:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140442880:0@lo:400:kworker.0 00000100:00100000:3.0:1788664182.846420:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664182.846438:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140443392:0@lo:400:kworker.0 00000100:00100000:3.0:1788664182.846458:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664182.846473:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c435358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140443904:0@lo:400:kworker.0 00000100:00100000:3.0:1788664182.846492:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664182.846519:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140443008 00000100:00100000:3.0:1788664182.846527:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140443008 00000100:00100000:3.0:1788664182.846568:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788664182.846577:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140443008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664182.846631:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140443008:12345-0@lo:400:kworker.0 Request processed in 54us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664182.846650:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788664182.846673:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140442880 00000100:00100000:3.0:1788664182.846676:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140442880 00000100:00100000:3.0:1788664182.846698:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140443392 00000100:00100000:3.0:1788664182.846701:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140443392 00000100:00100000:3.0:1788664182.846724:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140443904 00000100:00100000:3.0:1788664182.846727:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140443904 00000100:00100000:3.0:1788664182.846740:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788664182.846746:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140442880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664182.846803:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140442880:12345-0@lo:400:kworker.0 Request processed in 56us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664182.846810:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788664182.846831:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788664182.846837:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140443392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664182.846867:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140443392:12345-0@lo:400:kworker.0 Request processed in 31us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664182.846873:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788664182.846886:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788664182.846891:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140443904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664182.846917:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140443904:12345-0@lo:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664182.846923:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788664182.846947:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788664182.846976:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140442880:0@lo:400:kworker.0 00010000:00080000:3.0:1788664182.846990:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43526f480 x1875550140443392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664182.846999:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140443392:0@lo:400:kworker.0 00010000:00080000:3.0:1788664182.847008:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c435358e00 x1875550140443904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664182.847015:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c435358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140443904:0@lo:400:kworker.0 00000100:00100000:3.0:1788664182.847023:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140443008:0@lo:400:kworker.0 00000100:00100000:0.0:1788664182.847311:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140443136:0@lo:400:kworker.0 00000100:00100000:0.0:1788664182.847344:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664182.847369:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43535b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140443648:0@lo:400:kworker.0 00000100:00100000:0.0:1788664182.847404:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664182.847420:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140444160:0@lo:400:kworker.0 00000100:00100000:0.0:1788664182.847440:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664182.847477:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140443520 00000100:00100000:0.0:1788664182.847482:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140443520 00000100:00100000:0.0:1788664182.847509:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140444032 00000100:00100000:0.0:1788664182.847512:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140444032 00000100:00100000:0.0:1788664182.847522:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140443648 00000100:00100000:0.0:1788664182.847524:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140443648 00000100:00100000:0.0:1788664182.847534:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140444160 00000100:00100000:0.0:1788664182.847536:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140444160 00000100:00100000:0.0:1788664182.847547:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788664182.847553:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140443520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664182.847590:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140443520:12345-0@lo:400:kworker.0 Request processed in 36us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664182.847596:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788664182.847607:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788664182.847613:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140444032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664182.847651:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140444032:12345-0@lo:400:kworker.0 Request processed in 38us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664182.847657:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788664182.847667:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788664182.847673:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140443648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664182.847699:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140443648:12345-0@lo:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664182.847705:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788664182.847715:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788664182.847721:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140444160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664182.847746:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140444160:12345-0@lo:400:kworker.0 Request processed in 25us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664182.847752:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788664182.847792:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664182.847795:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788664182.847815:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43535ad80 x1875550140443520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664182.847826:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43535ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140443520:0@lo:400:kworker.0 00010000:00080000:0.0:1788664182.847836:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43535a300 x1875550140444032/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664182.847844:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43535a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140444032:0@lo:400:kworker.0 00010000:00080000:0.0:1788664182.847869:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e6a00 x1875550140444160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664182.847877:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140444160:0@lo:400:kworker.0 00010000:00080000:0.0:1788664182.847892:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43535b100 x1875550140443648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664182.847900:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43535b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140443648:0@lo:400:kworker.0 00000100:00100000:0.0:1788664182.847906:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788664182.847913:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140442752:0@lo:400:kworker.0 00000100:00100000:0.0:1788664182.847940:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664182.847963:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140443264:0@lo:400:kworker.0 00000100:00100000:0.0:1788664182.847983:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664182.848021:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c435359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140443776:0@lo:400:kworker.0 00000100:00100000:0.0:1788664182.848040:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664182.848315:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140443136 00000100:00100000:1.0:1788664182.848320:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140443136 00000100:00100000:1.0:1788664182.848358:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140443264 00000100:00100000:1.0:1788664182.848361:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140443264 00000100:00100000:1.0:1788664182.848379:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140443776 00000100:00100000:1.0:1788664182.848381:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140443776 00000100:00100000:1.0:1788664182.848412:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788664182.848418:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140443136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664182.848456:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140443136:12345-0@lo:400:kworker.0 Request processed in 38us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664182.848462:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788664182.848476:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788664182.848480:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140443264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664182.848504:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140443264:12345-0@lo:400:kworker.0 Request processed in 24us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664182.848509:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788664182.848519:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788664182.848524:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140443776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664182.848545:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140443776:12345-0@lo:400:kworker.0 Request processed in 22us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664182.848550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1788664182.848567:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664182.848584:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140443264:0@lo:400:kworker.0 00000100:00100000:1.0:1788664182.848593:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c435359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140443776:0@lo:400:kworker.0 00000100:00100000:1.0:1788664182.848601:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140443136:0@lo:400:kworker.0 00000100:00100000:2.0:1788664182.849364:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140442752 00000100:00100000:2.0:1788664182.849371:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140442752 00000100:00100000:2.0:1788664182.849422:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788664182.849430:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140442752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664182.849486:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140442752:12345-0@lo:400:kworker.0 Request processed in 57us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664182.849491:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788664182.849642:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140442752:0@lo:400:kworker.0 00000100:00100000:0.0:1788664182.849972:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664182.849992:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140444288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664182.850029:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664182.850114:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140444288 00000100:00100000:1.0:1788664182.850119:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140444288 00000100:00100000:1.0:1788664182.850155:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788664182.850164:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140444288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664182.850187:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664182.850225:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140444288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664182.850231:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788664182.850363:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303ab8e00 x1875550140444288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664182.850378:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140444288:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788664183.229997:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664183.358031:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664183.358054:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140444416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664183.358126:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664183.358186:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140444416 00000100:00100000:1.0:1788664183.358193:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140444416 00000100:00100000:1.0:1788664183.358239:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788664183.358247:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140444416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788664183.358268:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664183.358312:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140444416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664183.358320:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788664183.358360:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303ab8380 x1875550140444416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664183.358377:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140444416:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1788664183.758832:0:11117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.4 00000100:00100000:2.0:1788664183.872262:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140444544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788664183.872377:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664183.872506:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140444544 00000100:00100000:1.0:1788664183.872513:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140444544 00000100:00100000:1.0:1788664183.872567:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788664183.872577:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140444544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664183.872624:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788664183.872672:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140444544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664183.872678:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788664183.872766:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140444544:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788664184.253980:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664184.382905:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140444672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664184.382995:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664184.383787:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140444672 00000100:00100000:1.0:1788664184.383795:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140444672 00000100:00100000:1.0:1788664184.383842:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788664184.383850:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140444672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788664184.383883:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664184.383931:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140444672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664184.383937:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788664184.383956:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788664184.384253:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303743100 x1875550140444672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664184.384274:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140444672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788664184.384294:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664184.384301:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140444800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664184.384333:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664184.384693:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140444800 00000100:00100000:1.0:1788664184.384698:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140444800 00000100:00100000:1.0:1788664184.384731:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788664184.384737:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140444800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664184.384750:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664184.384805:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140444800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664184.384820:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788664184.384839:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788664184.384953:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303ab9c00 x1875550140444800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664184.384967:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140444800:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788664185.278981:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664185.501713:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664185.501762:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664185.501839:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664185.501868:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119404800 00000100:00100000:3.0:1788664185.501889:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119404800 00000100:00100000:3.0:1788664185.501951:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119404928 00000100:00100000:3.0:1788664185.501955:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119404928 00000100:00100000:3.0:1788664185.501979:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:3.0:1788664185.501988:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119404800:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664185.501990:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:2.0:1788664185.501999:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119404928:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664185.502075:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119404928:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 76us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664185.502083:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:0.0:1788664185.502086:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119404672 00000100:00100000:0.0:1788664185.502091:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119404672 00000100:00100000:0.0:1788664185.502121:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 281 00000100:00100000:0.0:1788664185.502127:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2391:x1875550119404672:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664185.502153:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2391:x1875550119404672:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664185.502159:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 281 00000100:00080000:1.0:1788664185.502320:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664185.502325:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664185.502518:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119404800:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 529us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664185.502526:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 98 00000001:00100000:3.0:1788664185.931826:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000020:00000080:3.0:1788664185.931835:0:8422:0:(genops.c:885:class_export_put()) final put ffff93c303734800/b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000020:00000080:1.0:1788664185.931923:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c303734800/b07edea8-5696-4cd5-9a12-cefd3a8358e9 for lustre-OST0000 00000020:00000080:1.0:1788664185.931991:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c303733000 for lustre-OST0000 00000001:00100000:0.0:1788664185.932190:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000020:00000080:0.0:1788664185.932195:0:9506:0:(genops.c:885:class_export_put()) final put ffff93c303737000/b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000020:00000080:2.0:1788664185.932260:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c303737000/b07edea8-5696-4cd5-9a12-cefd3a8358e9 for lustre-OST0001 00000020:00000080:2.0:1788664185.932295:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c303732000 for lustre-OST0001 00010000:00010000:3.0:1788664186.302057:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788664186.936058:0:11214:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.4 00010000:00010000:2.0:1788664187.331541:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664187.454417:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140444928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664187.454515:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664187.454618:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140444928 00000100:00100000:2.0:1788664187.454626:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140444928 00000100:00100000:2.0:1788664187.454698:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788664187.454708:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140444928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788664187.454740:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788664187.454808:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140444928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664187.454816:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788664187.454940:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140444928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664187.969967:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140445184:0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.970189:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140445056:0@lo:400:kworker.0 00000100:00100000:2.0:1788664187.976884:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140445312:0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.977007:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664187.977081:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140445568:0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.977108:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664187.977129:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140446080:0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.977153:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664187.977176:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140446592:0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.977197:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664187.977220:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788664187.977227:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140445440:0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.977251:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664187.977283:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140445952:0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.977308:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664187.977325:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140446464:0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.977346:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664187.977401:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140445056 00000100:00100000:3.0:1788664187.977409:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140445056 00000100:00100000:3.0:1788664187.977457:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788664187.977468:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140445056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.977523:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140445056:12345-0@lo:400:kworker.0 Request processed in 57us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664187.977530:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788664187.977561:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140446080 00000100:00100000:3.0:1788664187.977564:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140446080 00000100:00100000:3.0:1788664187.977592:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140446592 00000100:00100000:3.0:1788664187.977595:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140446592 00000100:00100000:3.0:1788664187.977606:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140445952 00000100:00100000:3.0:1788664187.977608:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140445952 00000100:00100000:3.0:1788664187.977618:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140446464 00000100:00100000:3.0:1788664187.977620:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140446464 00000100:00100000:3.0:1788664187.977633:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788664187.977640:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140446080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.977675:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140446080:12345-0@lo:400:kworker.0 Request processed in 35us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664187.977682:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788664187.977692:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788664187.977698:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140446592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.977740:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140446592:12345-0@lo:400:kworker.0 Request processed in 43us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664187.977757:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788664187.977790:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788664187.977797:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140445952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.977829:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140445952:12345-0@lo:400:kworker.0 Request processed in 33us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664187.977835:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788664187.977848:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788664187.977854:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140446464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.977881:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140446464:12345-0@lo:400:kworker.0 Request processed in 28us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664187.977886:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788664187.977904:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140445440 00000100:00100000:3.0:1788664187.977907:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140445440 00000100:00100000:3.0:1788664187.977933:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788664187.977939:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c435359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140445440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.977968:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c435359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140445440:12345-0@lo:400:kworker.0 Request processed in 30us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664187.977975:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788664187.978015:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140445440:0@lo:400:kworker.0 00010000:00080000:3.0:1788664187.978029:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303ab8e00 x1875550140445952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664187.978039:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140445952:0@lo:400:kworker.0 00010000:00080000:3.0:1788664187.978048:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f7800 x1875550140446464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664187.978071:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140446464:0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.978081:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140445056:0@lo:400:kworker.0 00010000:00080000:3.0:1788664187.978090:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303aba680 x1875550140446080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664187.978097:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140446080:0@lo:400:kworker.0 00010000:00080000:3.0:1788664187.978105:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f4000 x1875550140446592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664187.978113:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140446592:0@lo:400:kworker.0 00000100:00080000:3.0:1788664187.978145:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788664187.978149:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664187.978181:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140445568 00000100:00100000:3.0:1788664187.978185:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140445568 00000100:00100000:3.0:1788664187.978256:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788664187.978264:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140445568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664187.978304:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140445568:12345-0@lo:400:kworker.0 Request processed in 41us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664187.978310:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788664187.978334:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140445568:0@lo:400:kworker.0 00000100:00100000:1.0:1788664187.981330:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664187.981398:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140445696:0@lo:400:kworker.0 00000100:00100000:1.0:1788664187.981451:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664187.981521:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140446208:0@lo:400:kworker.0 00000100:00100000:1.0:1788664187.981547:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664187.981581:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43535ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140446720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664187.981608:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664187.981658:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140445184 00000100:00100000:1.0:1788664187.981665:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140445184 00000100:00100000:1.0:1788664187.981708:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140445696 00000100:00100000:1.0:1788664187.981712:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140445696 00000100:00100000:1.0:1788664187.981740:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140446208 00000100:00100000:1.0:1788664187.981743:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140446208 00000100:00100000:1.0:1788664187.981761:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788664187.981803:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140445184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664187.981874:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140445184:12345-0@lo:400:kworker.0 Request processed in 105us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664187.981883:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788664187.981901:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788664187.981909:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140445696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664187.981940:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140445696:12345-0@lo:400:kworker.0 Request processed in 32us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664187.981946:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788664187.981959:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788664187.981965:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140446208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664187.981993:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140446208:12345-0@lo:400:kworker.0 Request processed in 28us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664187.981998:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788664187.982021:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140446720 00000100:00100000:1.0:1788664187.982024:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140446720 00000100:00100000:1.0:1788664187.982048:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788664187.982054:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140446720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664187.982076:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664187.982108:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140446720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664187.982114:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788664187.982132:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788664187.982166:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43535ad80 x1875550140446720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664187.982449:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43535ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140446720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664187.982474:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140445184:0@lo:400:kworker.0 00000100:00100000:1.0:1788664187.982482:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140445696:0@lo:400:kworker.0 00000100:00100000:1.0:1788664187.982489:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140446208:0@lo:400:kworker.0 00000100:00100000:2.0:1788664187.984282:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664187.984330:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140445824:0@lo:400:kworker.0 00000100:00100000:2.0:1788664187.984383:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664187.984385:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140445312 00000100:00100000:1.0:1788664187.984393:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140445312 00000100:00100000:2.0:1788664187.984411:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140446336:0@lo:400:kworker.0 00000100:00100000:2.0:1788664187.984431:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664187.984433:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788664187.984442:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140445312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664187.984462:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140445824 00000100:00100000:2.0:1788664187.984466:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140445824 00000100:00100000:1.0:1788664187.984497:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140445312:12345-0@lo:400:kworker.0 Request processed in 57us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664187.984505:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788664187.984507:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140446336 00000100:00100000:2.0:1788664187.984509:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140446336 00000100:00100000:2.0:1788664187.984527:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788664187.984533:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140445824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664187.984566:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140445824:12345-0@lo:400:kworker.0 Request processed in 33us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664187.984573:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788664187.984584:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788664187.984590:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140446336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664187.984615:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140446336:12345-0@lo:400:kworker.0 Request processed in 25us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664187.984621:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788664187.984653:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140445312:0@lo:400:kworker.0 00010000:00080000:2.0:1788664187.984664:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303ab8380 x1875550140445824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664187.984674:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140445824:0@lo:400:kworker.0 00010000:00080000:2.0:1788664187.984683:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f4e00 x1875550140446336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664187.984690:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140446336:0@lo:400:kworker.0 00000100:00080000:2.0:1788664187.984720:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788664188.349906:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664188.478704:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664188.478735:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140446848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664188.478856:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664188.478986:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140446848 00000100:00100000:1.0:1788664188.478995:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140446848 00000100:00100000:1.0:1788664188.479043:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788664188.479054:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140446848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788664188.479081:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664188.479126:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140446848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664188.479134:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788664188.479318:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f4e00 x1875550140446848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664188.479342:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140446848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664188.990111:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664188.990136:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140446976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788664188.990206:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664188.990971:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140446976 00000100:00100000:2.0:1788664188.990982:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140446976 00000100:00100000:2.0:1788664188.991049:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788664188.991059:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140446976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788664188.991096:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788664188.991177:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140446976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664188.991183:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788664188.991609:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140446976:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788664189.374530:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664189.502095:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664189.502120:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140447104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664189.502188:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664189.502602:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664189.502620:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140447232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664189.502658:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664189.504140:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140447104 00000100:00100000:0.0:1788664189.504151:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140447104 00000100:00100000:0.0:1788664189.504207:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140447232 00000100:00100000:0.0:1788664189.504210:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140447232 00000100:00100000:0.0:1788664189.504229:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788664189.504237:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140447104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664189.504266:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664189.504357:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140447104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664189.504364:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788664189.504379:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788664189.504385:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c435358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140447232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788664189.504396:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664189.504429:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c435358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140447232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664189.504434:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788664189.504612:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f7800 x1875550140447104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664189.504647:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140447104:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788664189.504984:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788664189.505064:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c301eaaa00 x1875550140447232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664189.505079:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140447232:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788664190.404052:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664190.616024:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664190.616070:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664190.616099:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664190.616124:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119405056 00000100:00100000:3.0:1788664190.616133:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119405056 00000100:00100000:3.0:1788664190.616180:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 283 00000100:00100000:3.0:1788664190.616190:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2390:x1875550119405056:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664190.616252:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2390:x1875550119405056:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 65us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664190.616260:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 283 00000100:00100000:2.0:1788664190.616353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119405184 00000100:00100000:2.0:1788664190.616359:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119405184 00000100:00100000:2.0:1788664190.616404:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119405312 00000100:00100000:2.0:1788664190.616408:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119405312 00000100:00100000:2.0:1788664190.616429:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:2.0:1788664190.616436:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2390:x1875550119405184:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664190.616467:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2390:x1875550119405184:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664190.616473:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:2.0:1788664190.616485:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:2.0:1788664190.616491:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119405312:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664190.616511:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119405312:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 20us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664190.616517:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00080000:3.0:1788664190.618537:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788664190.618545:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788664190.669525:0:11312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.4 00010000:00010000:1.0:1788664191.421930:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664192.450830:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664192.579260:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664192.579285:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140447360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664192.579365:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664192.579430:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140447360 00000100:00100000:1.0:1788664192.579438:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140447360 00000100:00100000:3.0:1788664192.587298:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788664192.587318:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140447360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664192.587367:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788664192.587635:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140447360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664192.591434:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140447360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4114us (12059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664192.591448:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000001:02000400:2.0:1788664192.625992:0:11360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 23:09:50 EDT 2026 00000100:00100000:1.0:1788664193.086637:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664193.086666:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140447488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664193.086744:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664193.086879:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140447488 00000100:00100000:3.0:1788664193.086888:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140447488 00000100:00100000:3.0:1788664193.086950:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788664193.086960:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140447488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664193.087005:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664193.087053:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140447488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664193.087061:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788664193.087102:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abaa00 x1875550140447488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664193.087120:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140447488:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788664193.087182:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664193.087369:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140447872:0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.087400:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664193.087428:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140448384:0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.087449:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664193.087471:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140448896:0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.087489:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664193.087511:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788664193.087516:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140447744:0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.087536:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664193.087551:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140448256:0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.087570:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664193.087588:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140448768:0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.087604:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664193.087629:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140448384 00000100:00100000:0.0:1788664193.087633:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140448384 00000100:00100000:0.0:1788664193.087658:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140448896 00000100:00100000:0.0:1788664193.087661:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140448896 00000100:00100000:0.0:1788664193.087671:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140447744 00000100:00100000:0.0:1788664193.087673:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140447744 00000100:00100000:0.0:1788664193.087680:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140448256 00000100:00100000:0.0:1788664193.087683:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140448256 00000100:00100000:0.0:1788664193.087693:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140448768 00000100:00100000:0.0:1788664193.087695:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140448768 00000100:00100000:0.0:1788664193.087706:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788664193.087711:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140448384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.087743:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140448384:12345-0@lo:400:kworker.0 Request processed in 32us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664193.087749:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788664193.087759:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788664193.087764:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140448896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.087809:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140448896:12345-0@lo:400:kworker.0 Request processed in 45us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664193.087826:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788664193.087840:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788664193.087845:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140447744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.087874:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140447744:12345-0@lo:400:kworker.0 Request processed in 29us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664193.087879:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788664193.087889:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788664193.087896:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140448256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.087920:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140448256:12345-0@lo:400:kworker.0 Request processed in 25us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664193.087925:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788664193.087936:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788664193.087942:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140448768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.087967:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140448768:12345-0@lo:400:kworker.0 Request processed in 26us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664193.087972:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788664193.087997:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140447744:0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.088006:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140448256:0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.088014:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140448768:0@lo:400:kworker.0 00010000:00080000:0.0:1788664193.088023:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350fed80 x1875550140448384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664193.088032:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140448384:0@lo:400:kworker.0 00010000:00080000:0.0:1788664193.088040:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350ff480 x1875550140448896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664193.088056:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140448896:0@lo:400:kworker.0 00000100:00100000:1.0:1788664193.088147:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140447872 00000100:00100000:1.0:1788664193.088152:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140447872 00000100:00100000:1.0:1788664193.088187:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788664193.088194:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140447872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664193.088233:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140447872:12345-0@lo:400:kworker.0 Request processed in 39us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664193.088239:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788664193.088254:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788664193.088257:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788664193.088272:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140447872:0@lo:400:kworker.0 00000100:00100000:3.0:1788664193.089071:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140447616:0@lo:400:kworker.0 00000100:00100000:3.0:1788664193.089119:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664193.089161:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140448128:0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.089175:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140447616 00000100:00100000:0.0:1788664193.089183:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140447616 00000100:00100000:3.0:1788664193.089187:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664193.089216:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140448640:0@lo:400:kworker.0 00000100:00100000:3.0:1788664193.089240:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664193.089268:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788664193.089275:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140448000:0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.089290:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788664193.089300:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140447616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664193.089303:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664193.089338:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140448512:0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.089379:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140447616:12345-0@lo:400:kworker.0 Request processed in 80us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664193.089387:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788664193.089409:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140448128 00000100:00100000:2.0:1788664193.089481:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140448000 00000100:00100000:2.0:1788664193.089488:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140448000 00000100:00100000:2.0:1788664193.089512:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788664193.089518:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140448000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664193.089878:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140448128 00000100:00100000:1.0:1788664193.089912:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788664193.089920:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140448128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664193.090177:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664193.090203:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140449024:0@lo:400:kworker.0 00000100:00100000:3.0:1788664193.090229:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664193.090256:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140447616:0@lo:400:kworker.0 00000100:00100000:3.0:1788664193.090290:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140448640 00000100:00100000:3.0:1788664193.090294:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140448640 00000100:00100000:3.0:1788664193.090341:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140448512 00000100:00100000:3.0:1788664193.090352:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140448512 00000100:00100000:3.0:1788664193.090371:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140449024 00000100:00100000:3.0:1788664193.090374:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140449024 00000100:00100000:3.0:1788664193.090390:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788664193.090397:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140448640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.090420:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788664193.090432:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140448512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664193.090442:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140448640:12345-0@lo:400:kworker.0 Request processed in 44us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664193.090449:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788664193.090464:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788664193.090472:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140449024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664193.090480:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140448512:12345-0@lo:400:kworker.0 Request processed in 49us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664193.090487:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788664193.090509:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140449024:12345-0@lo:400:kworker.0 Request processed in 37us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664193.090516:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788664193.090516:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664193.090523:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788664193.090556:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350fe680 x1875550140448512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664193.090569:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140448512:0@lo:400:kworker.0 00010000:00080000:3.0:1788664193.090578:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350ff100 x1875550140449024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664193.090586:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140449024:0@lo:400:kworker.0 00010000:00080000:3.0:1788664193.090595:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350fdf80 x1875550140448640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664193.090602:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140448640:0@lo:400:kworker.0 00000100:00100000:2.0:1788664193.092792:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140448000:12345-0@lo:400:kworker.0 Request processed in 3252us (3468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664193.092806:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788664193.092928:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140448128:12345-0@lo:400:kworker.0 Request processed in 3007us (3739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664193.092937:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788664193.093296:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140448000:0@lo:400:kworker.0 00000100:00100000:3.0:1788664193.093310:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140448128:0@lo:400:kworker.0 00010000:00010000:2.0:1788664193.470000:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664193.601087:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664193.601109:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140449152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664193.601190:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664193.601572:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140449152 00000100:00100000:0.0:1788664193.601581:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140449152 00000100:00100000:0.0:1788664193.601636:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788664193.601646:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140449152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664193.601668:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664193.601725:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140449152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664193.601732:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1788664193.601836:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f4e00 x1875550140449152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664193.601855:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140449152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788664194.113594:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664194.113617:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140449280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788664194.113696:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664194.113873:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140449280 00000100:00100000:2.0:1788664194.113881:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140449280 00000100:00100000:2.0:1788664194.113926:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788664194.113935:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140449280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788664194.113968:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788664194.114024:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140449280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664194.114030:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788664194.114194:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140449280:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788664194.496680:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664194.622326:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140449408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664194.622428:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664194.622571:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140449408 00000100:00100000:1.0:1788664194.622582:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140449408 00000100:00100000:1.0:1788664194.622651:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788664194.622663:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140449408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664194.622716:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664194.622809:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140449408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664194.622838:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788664194.622890:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f4e00 x1875550140449408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664194.622913:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140449408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664194.623702:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664194.623720:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140449536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788664194.623812:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664194.623878:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140449536 00000100:00100000:1.0:1788664194.623885:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140449536 00000100:00100000:1.0:1788664194.623930:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788664194.623939:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140449536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788664194.623959:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664194.624000:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140449536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664194.624008:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788664194.624050:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f4e00 x1875550140449536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664194.624068:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140449536:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788664195.518021:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664195.739882:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664195.739984:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664195.740026:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664195.740067:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119405440 00000100:00100000:3.0:1788664195.740076:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119405440 00000100:00100000:3.0:1788664195.740148:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 285 00000100:00100000:3.0:1788664195.740158:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2391:x1875550119405440:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664195.740227:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2391:x1875550119405440:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 71us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664195.740234:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 285 00000100:00100000:0.0:1788664195.749883:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119405568 00000100:00100000:0.0:1788664195.749896:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119405568 00000100:00100000:0.0:1788664195.750593:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119405696 00000100:00100000:0.0:1788664195.750599:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119405696 00000100:00100000:1.0:1788664195.751586:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:1.0:1788664195.751601:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119405568:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664195.751693:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119405568:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 97us (11819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664195.751701:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00080000:2.0:1788664195.753577:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788664195.753584:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664195.756054:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:0.0:1788664195.756070:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119405696:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664195.756396:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119405696:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 330us (16367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664195.756405:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00010000:00010000:2.0:1788664196.544005:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664197.566491:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664197.694766:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664197.694835:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140449664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664197.694904:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664197.695402:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140449664 00000100:00100000:2.0:1788664197.695412:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140449664 00000100:00100000:2.0:1788664197.695472:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788664197.695498:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140449664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788664197.695548:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788664197.695599:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140449664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664197.695607:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788664197.695766:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140449664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664198.206487:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140450176:0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.206555:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664198.206561:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140449920:0@lo:400:kworker.0 00000100:00100000:3.0:1788664198.206590:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664198.206604:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140450688:0@lo:400:kworker.0 00000100:00100000:3.0:1788664198.206608:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140450432:0@lo:400:kworker.0 00000100:00100000:3.0:1788664198.206627:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664198.206627:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664198.206648:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140450944:0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.206648:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140451200:0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.206666:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664198.206667:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664198.206688:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788664198.206694:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140450048:0@lo:400:kworker.0 00000100:00100000:3.0:1788664198.206699:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788664198.206704:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140449792:0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.206716:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664198.206734:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140450560:0@lo:400:kworker.0 00000100:00100000:3.0:1788664198.206741:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664198.206755:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664198.206759:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140450304:0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.206787:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140451072:0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.206807:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664198.206817:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664198.206832:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140450176 00000100:00100000:3.0:1788664198.206833:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140450816:0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.206839:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140450176 00000100:00100000:2.0:1788664198.206887:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140449920 00000100:00100000:2.0:1788664198.206890:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140449920 00000100:00100000:2.0:1788664198.206902:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140450432 00000100:00100000:2.0:1788664198.206904:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140450432 00000100:00100000:3.0:1788664198.207020:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664198.207039:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140451328:0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.207055:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140450944 00000100:00100000:2.0:1788664198.207058:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140450944 00000100:00100000:3.0:1788664198.207059:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664198.207076:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140450560 00000100:00100000:3.0:1788664198.207086:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140451072 00000100:00100000:2.0:1788664198.207086:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140450560 00000100:00100000:3.0:1788664198.207089:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140451072 00000100:00100000:3.0:1788664198.207107:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788664198.207168:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140450688 00000100:00100000:0.0:1788664198.207172:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140450688 00000100:00100000:0.0:1788664198.207193:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140451200 00000100:00100000:0.0:1788664198.207196:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140451200 00000100:00100000:0.0:1788664198.207209:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140450816 00000100:00100000:0.0:1788664198.207211:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140450816 00000100:00100000:0.0:1788664198.207222:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140451328 00000100:00100000:0.0:1788664198.207224:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140451328 00000100:00100000:0.0:1788664198.207236:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788664198.207242:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140450688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664198.207312:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140450688:12345-0@lo:400:kworker.0 Request processed in 69us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664198.207321:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788664198.207337:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788664198.207343:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140451200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664198.207371:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140451200:12345-0@lo:400:kworker.0 Request processed in 29us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664198.207376:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788664198.207386:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788664198.207392:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140450816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664198.207422:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140450816:12345-0@lo:400:kworker.0 Request processed in 30us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664198.207434:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788664198.207445:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788664198.207450:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140451328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664198.207479:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140451328:12345-0@lo:400:kworker.0 Request processed in 29us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664198.207486:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788664198.209986:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140450176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664198.210102:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140450176:12345-0@lo:400:kworker.0 Request processed in 137us (3546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664198.213412:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788664198.213441:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140449920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.213537:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140449920:12345-0@lo:400:kworker.0 Request processed in 112us (6946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664198.213544:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788664198.213579:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788664198.213586:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140450432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.213619:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140450432:12345-0@lo:400:kworker.0 Request processed in 35us (6991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664198.213625:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788664198.213638:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788664198.213643:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140450944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.213671:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140450944:12345-0@lo:400:kworker.0 Request processed in 29us (7004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664198.213676:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788664198.213687:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788664198.213693:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140451072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.213723:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140451072:12345-0@lo:400:kworker.0 Request processed in 30us (6914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664198.213729:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788664198.213741:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788664198.213748:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140450560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.213809:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140450560:12345-0@lo:400:kworker.0 Request processed in 62us (7053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664198.213836:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788664198.215077:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140450048 00000100:00100000:2.0:1788664198.215118:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140450048 00000100:00100000:2.0:1788664198.215170:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140450304 00000100:00100000:2.0:1788664198.215173:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140450304 00000100:00100000:2.0:1788664198.215186:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788664198.215192:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140450048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.215245:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140450048:12345-0@lo:400:kworker.0 Request processed in 54us (8528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664198.215251:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788664198.215359:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788664198.215367:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140450304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.215398:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140450304:12345-0@lo:400:kworker.0 Request processed in 33us (8580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664198.215403:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788664198.215449:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664198.215455:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664198.215458:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788664198.215460:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664198.215511:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664198.215523:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140451456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664198.215557:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664198.215591:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140451456 00000100:00100000:2.0:1788664198.215594:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140451456 00000100:00100000:2.0:1788664198.215618:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788664198.215624:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140451456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664198.215644:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664198.215690:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140451456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664198.215695:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788664198.215732:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f761f80 x1875550140451456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664198.215750:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140451456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664198.216416:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140450304:0@lo:400:kworker.0 00010000:00080000:2.0:1788664198.216431:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303ade300 x1875550140450816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664198.216441:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140450816:0@lo:400:kworker.0 00010000:00080000:2.0:1788664198.216451:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303addf80 x1875550140451328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664198.216458:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140451328:0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.216469:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140449920:0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.216480:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140450432:0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.216490:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140450944:0@lo:400:kworker.0 00000100:00100000:1.0:1788664198.219616:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140449792 00000100:00100000:1.0:1788664198.219627:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140449792 00000100:00100000:1.0:1788664198.219677:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788664198.219687:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140449792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664198.219800:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140449792:12345-0@lo:400:kworker.0 Request processed in 115us (13057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664198.219818:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788664198.220392:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140450048:0@lo:400:kworker.0 00010000:00080000:1.0:1788664198.220410:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303adc380 x1875550140450560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664198.220421:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140450560:0@lo:400:kworker.0 00010000:00080000:1.0:1788664198.220433:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303adfb80 x1875550140451072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664198.220442:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140451072:0@lo:400:kworker.0 00000100:00100000:1.0:1788664198.220455:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140450176:0@lo:400:kworker.0 00010000:00080000:1.0:1788664198.220466:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303adea00 x1875550140450688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664198.220476:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140450688:0@lo:400:kworker.0 00010000:00080000:1.0:1788664198.220487:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303addc00 x1875550140451200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664198.220504:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140451200:0@lo:400:kworker.0 00000100:00100000:2.0:1788664198.225633:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140449792:0@lo:400:kworker.0 00000100:00100000:3.0:1788664198.227098:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00010000:0.0:1788664198.595027:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664198.728437:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140451584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664198.728512:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664198.728583:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140451584 00000100:00100000:2.0:1788664198.728591:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140451584 00000100:00100000:2.0:1788664198.728629:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788664198.728642:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140451584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788664198.728665:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664198.728703:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140451584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664198.728710:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788664198.729031:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350ff480 x1875550140451584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664198.729050:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140451584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664199.231950:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140451712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664199.232038:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664199.232174:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140451712 00000100:00100000:2.0:1788664199.232183:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140451712 00000100:00100000:2.0:1788664199.232246:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788664199.232256:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140451712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788664199.232303:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788664199.232361:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140451712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664199.232369:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788664199.232450:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140451712:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788664199.614284:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664199.742173:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140451840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664199.742295:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664199.742433:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140451840 00000100:00100000:0.0:1788664199.742444:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140451840 00000100:00100000:0.0:1788664199.742504:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788664199.742513:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140451840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788664199.742549:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664199.746873:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140451968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664199.746978:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664199.747054:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788664199.747065:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788664199.747236:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140451968 00000100:00100000:1.0:1788664199.747245:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140451968 00000100:00100000:1.0:1788664199.747566:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788664199.747577:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140451968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664199.747609:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664199.747676:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140451968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664199.747683:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788664199.747740:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f763800 x1875550140451968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664199.747766:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140451968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664199.748097:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140451840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5583us (5800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664199.748106:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788664199.751086:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42e979c00 x1875550140451840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664199.751120:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140451840:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788664200.638941:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664200.858416:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664200.858459:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664200.858498:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664200.858528:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119406080 00000100:00100000:2.0:1788664200.858539:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119406080 00000100:00100000:2.0:1788664200.858598:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119405952 00000100:00100000:2.0:1788664200.858602:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119405952 00000100:00100000:2.0:1788664200.858626:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:2.0:1788664200.858636:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119406080:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664200.858731:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119406080:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 96us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664200.858740:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:2.0:1788664200.858761:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:2.0:1788664200.858768:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119405952:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664200.858818:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119405952:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 51us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664200.858824:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00080000:2.0:1788664200.858842:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664200.858846:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788664200.859162:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119405824 00000100:00100000:3.0:1788664200.859168:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119405824 00000100:00100000:3.0:1788664200.859212:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 287 00000100:00100000:3.0:1788664200.859220:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2391:x1875550119405824:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664200.859282:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2391:x1875550119405824:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 63us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664200.859289:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 287 00010000:00010000:0.0:1788664201.665094:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664202.687313:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664202.814135:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140452096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664202.814231:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664202.814308:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140452096 00000100:00100000:0.0:1788664202.814316:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140452096 00000100:00100000:0.0:1788664202.814374:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788664202.814385:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140452096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788664202.814417:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788664202.814475:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140452096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664202.814483:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788664202.825541:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140452096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664203.328259:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140452608:0@lo:400:kworker.0 00000100:00100000:3.0:1788664203.328333:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664203.328384:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140453120:0@lo:400:kworker.0 00000100:00100000:3.0:1788664203.328408:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664203.328428:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140453632:0@lo:400:kworker.0 00000100:00100000:3.0:1788664203.328448:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664203.328480:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788664203.328486:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140452224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664203.328509:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664203.328528:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140452736:0@lo:400:kworker.0 00000100:00100000:3.0:1788664203.328583:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664203.328603:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140453248:0@lo:400:kworker.0 00000100:00100000:3.0:1788664203.328627:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664203.328799:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140452352:0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.328834:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664203.328857:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140452864:0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.328878:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664203.328895:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140453376:0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.328913:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664203.328929:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140453888:0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.328949:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664203.328966:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788664203.328970:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140452480:0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.328991:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664203.329009:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140452992:0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.329028:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664203.329053:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140453504:0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.329070:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664203.329091:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140453120 00000100:00100000:2.0:1788664203.329097:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140453120 00000100:00100000:2.0:1788664203.329137:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140453632 00000100:00100000:2.0:1788664203.329139:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140453632 00000100:00100000:2.0:1788664203.329151:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140452736 00000100:00100000:2.0:1788664203.329153:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140452736 00000100:00100000:2.0:1788664203.329163:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140452480 00000100:00100000:2.0:1788664203.329165:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140452480 00000100:00100000:2.0:1788664203.329174:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140452992 00000100:00100000:2.0:1788664203.329176:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140452992 00000100:00100000:2.0:1788664203.329186:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140453504 00000100:00100000:2.0:1788664203.329188:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140453504 00000100:00100000:2.0:1788664203.329199:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788664203.329206:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140453120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.329264:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140453120:12345-0@lo:400:kworker.0 Request processed in 57us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664203.329271:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788664203.329288:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788664203.329293:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140453632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.329320:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140453632:12345-0@lo:400:kworker.0 Request processed in 26us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664203.329325:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788664203.329339:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788664203.329344:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140452736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.329368:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140452736:12345-0@lo:400:kworker.0 Request processed in 25us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664203.329382:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788664203.329394:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788664203.329399:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140452480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.329445:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140452480:12345-0@lo:400:kworker.0 Request processed in 45us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664203.329451:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788664203.329471:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788664203.329477:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140452992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.329502:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140452992:12345-0@lo:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664203.329507:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788664203.329516:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788664203.329522:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140453504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.329546:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140453504:12345-0@lo:400:kworker.0 Request processed in 25us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664203.329551:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788664203.329569:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140452352 00000100:00100000:2.0:1788664203.329573:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140452352 00000100:00100000:2.0:1788664203.329597:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788664203.329604:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140452352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.329630:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140452352:12345-0@lo:400:kworker.0 Request processed in 26us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664203.329636:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788664203.329800:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140452608 00000100:00100000:2.0:1788664203.329805:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140452608 00000100:00100000:2.0:1788664203.329836:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140452864 00000100:00100000:2.0:1788664203.329839:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140452864 00000100:00100000:2.0:1788664203.329850:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788664203.329856:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140452608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.329900:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140452608:12345-0@lo:400:kworker.0 Request processed in 44us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664203.329906:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788664203.329917:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788664203.329923:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140452864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.329949:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140452864:12345-0@lo:400:kworker.0 Request processed in 26us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664203.329954:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788664203.329970:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140453248 00000100:00100000:2.0:1788664203.329973:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140453248 00000100:00100000:2.0:1788664203.329995:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140453376 00000100:00100000:2.0:1788664203.329998:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140453376 00000100:00100000:2.0:1788664203.330009:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140453888 00000100:00100000:2.0:1788664203.330011:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140453888 00000100:00100000:2.0:1788664203.330023:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788664203.330028:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140453248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.330058:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140453248:12345-0@lo:400:kworker.0 Request processed in 30us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664203.330064:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788664203.330075:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788664203.330079:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140453376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.330102:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140453376:12345-0@lo:400:kworker.0 Request processed in 23us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664203.330116:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788664203.330128:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788664203.330143:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140453888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.330171:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140453888:12345-0@lo:400:kworker.0 Request processed in 29us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664203.330176:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788664203.330202:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664203.330206:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664203.330209:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664203.330211:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664203.330335:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140452480:0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.330346:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140452992:0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.330353:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140453504:0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.330361:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140452352:0@lo:400:kworker.0 00000100:00100000:2.0:1788664203.330369:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140452864:0@lo:400:kworker.0 00010000:00080000:2.0:1788664203.330379:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039ca680 x1875550140453376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664203.330388:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140453376:0@lo:400:kworker.0 00010000:00080000:2.0:1788664203.330398:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039cb100 x1875550140453888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664203.330406:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140453888:0@lo:400:kworker.0 00010000:00080000:3.0:1788664203.330565:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039cad80 x1875550140453248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664203.330574:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140453248:0@lo:400:kworker.0 00000100:00100000:3.0:1788664203.330582:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140453760:0@lo:400:kworker.0 00000100:00100000:3.0:1788664203.330618:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664203.330657:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140452608:0@lo:400:kworker.0 00010000:00080000:3.0:1788664203.330668:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039c9880 x1875550140453120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664203.330676:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140453120:0@lo:400:kworker.0 00010000:00080000:3.0:1788664203.330687:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039c9180 x1875550140453632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664203.330695:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140453632:0@lo:400:kworker.0 00000100:00100000:3.0:1788664203.330714:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140452736:0@lo:400:kworker.0 00000100:00100000:3.0:1788664203.330744:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140452224 00000100:00100000:3.0:1788664203.330748:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140452224 00000100:00100000:3.0:1788664203.330790:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788664203.330797:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140452224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664203.330819:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664203.330853:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140452224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (2342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664203.330858:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788664203.330876:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140453760 00000100:00100000:3.0:1788664203.330879:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140453760 00000100:00100000:3.0:1788664203.330901:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788664203.330906:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140453760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664203.330931:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140453760:12345-0@lo:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664203.330936:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788664203.330961:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788664203.330976:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f761c00 x1875550140452224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664203.330990:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140452224:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788664203.330999:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039cb480 x1875550140453760/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664203.331005:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140453760:0@lo:400:kworker.0 00010000:00010000:1.0:1788664203.711874:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664203.840597:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664203.840618:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140454016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664203.840692:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664203.840747:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140454016 00000100:00100000:0.0:1788664203.840753:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140454016 00000100:00100000:0.0:1788664203.840832:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788664203.840840:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140454016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664203.840860:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664203.840898:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140454016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664203.840905:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788664203.840940:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350fed80 x1875550140454016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664203.840959:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140454016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664204.351158:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664204.351179:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140454144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664204.351258:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664204.351323:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140454144 00000100:00100000:1.0:1788664204.351330:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140454144 00000100:00100000:1.0:1788664204.351386:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788664204.351395:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140454144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664204.351441:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788664204.351799:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140454144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664204.351818:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788664204.351869:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140454144:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788664204.737506:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664204.862007:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664204.862029:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140454272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664204.862099:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664204.862168:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140454272 00000100:00100000:1.0:1788664204.862185:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140454272 00000100:00100000:1.0:1788664204.862266:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788664204.862278:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140454272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664204.862320:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664204.862422:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140454272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664204.862429:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1788664204.862546:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350fed80 x1875550140454272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664204.862568:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140454272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664204.865714:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664204.865742:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140454400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664204.866263:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664204.866306:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140454400 00000100:00100000:0.0:1788664204.866315:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140454400 00000100:00100000:0.0:1788664204.866373:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788664204.866384:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140454400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788664204.866411:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664204.866477:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140454400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664204.866496:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1788664204.866918:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42e979c00 x1875550140454400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664204.866937:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140454400:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788664205.766853:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664205.981844:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664205.981947:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664205.981987:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119406336 00000100:00100000:3.0:1788664205.982000:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119406336 00000100:00100000:3.0:1788664205.982094:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:3.0:1788664205.982106:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119406336:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664205.982206:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119406336:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 102us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664205.982215:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:3.0:1788664205.982252:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119406208 00000100:00100000:3.0:1788664205.982256:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119406208 00000100:00100000:3.0:1788664205.982372:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 289 00000100:00100000:3.0:1788664205.982380:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2391:x1875550119406208:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664205.982409:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2391:x1875550119406208:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664205.982415:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 289 00000100:00080000:3.0:1788664205.982445:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664205.990017:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664205.990307:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119406464 00000100:00100000:3.0:1788664205.990320:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119406464 00000100:00100000:3.0:1788664205.990514:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:3.0:1788664205.990525:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119406464:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664205.990628:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119406464:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 105us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664205.990636:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00080000:1.0:1788664205.995530:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788664206.782459:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664207.807069:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664207.935132:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664207.935163:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140454528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664207.935267:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664207.935392:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140454528 00000100:00100000:3.0:1788664207.935403:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140454528 00000100:00100000:3.0:1788664207.935469:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788664207.935479:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140454528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664207.935522:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788664207.935582:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140454528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664207.935590:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788664207.935643:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140454528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664208.446712:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140454656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664208.446826:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664208.446937:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140454656 00000100:00100000:3.0:1788664208.446947:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140454656 00000100:00100000:3.0:1788664208.447010:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788664208.447021:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140454656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664208.447057:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664208.447105:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140454656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664208.447112:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788664208.447135:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788664208.447166:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3035a4380 x1875550140454656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664208.447185:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140454656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664208.447724:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140454912:0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.447768:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664208.447826:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140455424:0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.447863:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664208.447889:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140455936:0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.447912:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664208.447935:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788664208.447941:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140455040:0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.447970:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664208.447992:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140455552:0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.448018:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664208.448040:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140456064:0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.448060:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664208.448105:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140454912 00000100:00100000:3.0:1788664208.448110:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140454912 00000100:00100000:3.0:1788664208.448147:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140455424 00000100:00100000:3.0:1788664208.448150:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140455424 00000100:00100000:3.0:1788664208.448174:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140455936 00000100:00100000:3.0:1788664208.448178:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140455936 00000100:00100000:3.0:1788664208.448195:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788664208.448203:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140454912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.448626:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140454912:12345-0@lo:400:kworker.0 Request processed in 420us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664208.448635:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788664208.448654:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788664208.448661:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140455424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.448693:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140455424:12345-0@lo:400:kworker.0 Request processed in 33us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664208.448700:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788664208.448712:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788664208.448718:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140455936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.448746:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140455936:12345-0@lo:400:kworker.0 Request processed in 29us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664208.448752:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788664208.448809:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140455040 00000100:00100000:3.0:1788664208.448815:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140455040 00000100:00100000:3.0:1788664208.448849:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788664208.448855:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140455040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.448889:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140455040:12345-0@lo:400:kworker.0 Request processed in 34us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664208.448905:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788664208.448927:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140455552 00000100:00100000:3.0:1788664208.448931:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140455552 00000100:00100000:3.0:1788664208.448959:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140456064 00000100:00100000:3.0:1788664208.448962:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140456064 00000100:00100000:3.0:1788664208.448980:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788664208.448985:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140455552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.449017:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140455552:12345-0@lo:400:kworker.0 Request processed in 32us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664208.449022:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788664208.449032:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788664208.449038:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140456064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.449066:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140456064:12345-0@lo:400:kworker.0 Request processed in 28us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664208.449072:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788664208.449114:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140454784:0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.449158:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664208.449197:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140455296:0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.449241:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664208.449264:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140455808:0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.449291:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664208.449316:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788664208.450157:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140455168:0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.450255:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664208.450306:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140455680:0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.450403:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664208.450452:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140454784 00000100:00100000:3.0:1788664208.450458:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140454784 00000100:00100000:3.0:1788664208.450518:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788664208.450532:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140454784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.450610:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140454784:12345-0@lo:400:kworker.0 Request processed in 81us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664208.450621:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788664208.450674:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140455296 00000100:00100000:3.0:1788664208.450679:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140455296 00000100:00100000:3.0:1788664208.450730:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140455808 00000100:00100000:3.0:1788664208.450735:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140455808 00000100:00100000:2.0:1788664208.450817:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140455680 00000100:00100000:2.0:1788664208.450823:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140455680 00000100:00100000:3.0:1788664208.450837:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140455168 00000100:00100000:3.0:1788664208.450842:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140455168 00000100:00100000:2.0:1788664208.450868:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788664208.450869:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788664208.450882:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140455680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.450883:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140455296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.450942:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140455296:12345-0@lo:400:kworker.0 Request processed in 63us (1700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664208.450948:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140455680:12345-0@lo:400:kworker.0 Request processed in 68us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664208.450953:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788664208.450963:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788664208.450973:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788664208.450981:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140455808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.451019:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140455808:12345-0@lo:400:kworker.0 Request processed in 40us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664208.451025:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788664208.451041:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788664208.451049:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140455168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.451081:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140455168:12345-0@lo:400:kworker.0 Request processed in 34us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664208.451094:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1788664208.451137:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664208.451143:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788664208.451145:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664208.451148:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788664208.451237:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140455168:0@lo:400:kworker.0 00010000:00080000:3.0:1788664208.451255:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3035a5f80 x1875550140455680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664208.451268:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140455680:0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.451280:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140454784:0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.451291:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140455296:0@lo:400:kworker.0 00000100:00100000:3.0:1788664208.451302:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140455808:0@lo:400:kworker.0 00000100:00100000:0.0:1788664208.451495:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140454912:0@lo:400:kworker.0 00010000:00080000:0.0:1788664208.451515:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3035a6d80 x1875550140455424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664208.451526:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140455424:0@lo:400:kworker.0 00010000:00080000:0.0:1788664208.451540:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3035a7480 x1875550140455936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664208.451549:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140455936:0@lo:400:kworker.0 00000100:00100000:0.0:1788664208.451575:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140455040:0@lo:400:kworker.0 00010000:00080000:0.0:1788664208.451590:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3035a6680 x1875550140455552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664208.451599:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140455552:0@lo:400:kworker.0 00010000:00080000:0.0:1788664208.451614:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3035a7100 x1875550140456064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664208.451622:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140456064:0@lo:400:kworker.0 00010000:00010000:3.0:1788664208.835268:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664208.962670:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140456192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788664208.962893:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664208.963022:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140456192 00000100:00100000:3.0:1788664208.963034:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140456192 00000100:00100000:3.0:1788664208.963105:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788664208.963117:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140456192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788664208.963193:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664208.963268:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140456192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 152us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664208.963277:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788664208.963338:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039d5f80 x1875550140456192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664208.963373:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140456192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664209.470755:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664209.470980:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140456320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788664209.471084:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664209.471229:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140456320 00000100:00100000:1.0:1788664209.471239:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140456320 00000100:00100000:1.0:1788664209.471311:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788664209.471323:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140456320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664209.471375:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788664209.471447:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140456320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664209.471455:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788664209.471531:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140456320:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788664209.868422:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664209.982050:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664209.982082:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140456448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664209.982224:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664209.982896:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140456448 00000100:00100000:0.0:1788664209.982909:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140456448 00000100:00100000:0.0:1788664209.982985:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788664209.982997:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140456448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664209.983063:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664209.983158:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140456448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664209.983166:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1788664209.985020:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350fc380 x1875550140456448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664209.985065:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140456448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664209.986033:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664209.986064:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140456576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664209.986161:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664209.986291:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140456576 00000100:00100000:1.0:1788664209.986299:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140456576 00000100:00100000:1.0:1788664209.986359:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788664209.986368:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140456576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788664209.986395:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664209.986465:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140456576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664209.986472:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1788664209.986970:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039d5f80 x1875550140456576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664209.986994:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140456576:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788664210.880908:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664211.100058:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664211.100545:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119406592 00000100:00100000:0.0:1788664211.100560:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119406592 00000100:00100000:0.0:1788664211.100637:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 291 00000100:00100000:0.0:1788664211.100649:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2391:x1875550119406592:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664211.100749:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2391:x1875550119406592:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 102us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664211.100758:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 291 00000100:00100000:3.0:1788664211.119068:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664211.119135:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664211.119353:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119406720 00000100:00100000:1.0:1788664211.119367:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119406720 00000100:00100000:1.0:1788664211.119463:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119406848 00000100:00100000:1.0:1788664211.119466:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119406848 00000100:00100000:1.0:1788664211.119491:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:1.0:1788664211.119503:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119406720:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664211.119604:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119406720:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 105us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664211.119613:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:1.0:1788664211.119632:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:1.0:1788664211.119638:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119406848:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664211.119660:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119406848:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664211.119687:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00080000:3.0:1788664211.121991:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788664211.122005:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788664211.904364:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664212.927981:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664213.057584:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664213.057627:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140456704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664213.057732:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664213.058694:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140456704 00000100:00100000:3.0:1788664213.058712:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140456704 00000100:00100000:3.0:1788664213.058885:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788664213.058897:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140456704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664213.058962:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788664213.059088:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140456704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 193us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664213.059096:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788664213.059385:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140456704:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1788664213.304522:0:11991:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:10:10 (1788664210) === 00000100:00100000:1.0:1788664213.578738:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140456832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664213.578885:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664213.579020:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140456832 00000100:00100000:1.0:1788664213.579031:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140456832 00000100:00100000:1.0:1788664213.579101:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788664213.579114:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140456832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664213.579166:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664213.579226:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140456832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664213.579235:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1788664213.579290:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039c8000 x1875550140456832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664213.579314:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140456832:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788664213.579639:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788664213.580265:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140457344:0@lo:400:kworker.0 00000100:00100000:1.0:1788664213.580318:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664213.580352:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140457856:0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.580450:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140457088:0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.580497:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664213.580524:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140457600:0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.580547:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664213.580564:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140458112:0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.580587:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664213.580609:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788664213.580615:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140456960:0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.580647:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664213.580689:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140457472:0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.580713:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664213.580730:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140457984:0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.580752:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664213.580796:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140457216:0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.580833:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664213.580854:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140457728:0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.580881:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664213.580913:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140458240:0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.580938:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664213.580973:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140457344 00000100:00100000:3.0:1788664213.580981:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140457344 00000100:00100000:3.0:1788664213.581021:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140457088 00000100:00100000:3.0:1788664213.581024:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140457088 00000100:00100000:3.0:1788664213.581036:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140457600 00000100:00100000:3.0:1788664213.581038:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140457600 00000100:00100000:3.0:1788664213.581062:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140458112 00000100:00100000:3.0:1788664213.581065:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140458112 00000100:00100000:3.0:1788664213.581077:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140457472 00000100:00100000:3.0:1788664213.581080:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140457472 00000100:00100000:3.0:1788664213.581091:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140457984 00000100:00100000:3.0:1788664213.581093:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140457984 00000100:00100000:3.0:1788664213.581109:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788664213.581118:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140457344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.581192:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140457344:12345-0@lo:400:kworker.0 Request processed in 74us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664213.581201:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788664213.581219:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788664213.581235:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140457088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.581270:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140457088:12345-0@lo:400:kworker.0 Request processed in 37us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664213.581275:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788664213.581286:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788664213.581292:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140457600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.581317:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140457600:12345-0@lo:400:kworker.0 Request processed in 27us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664213.581323:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788664213.581334:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788664213.581340:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140458112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.581376:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140458112:12345-0@lo:400:kworker.0 Request processed in 37us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664213.581383:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788664213.581393:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788664213.581398:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140457472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.581424:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140457472:12345-0@lo:400:kworker.0 Request processed in 26us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664213.581430:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788664213.581440:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788664213.581446:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140457984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.581473:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140457984:12345-0@lo:400:kworker.0 Request processed in 27us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664213.581479:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788664213.581513:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140456960 00000100:00100000:3.0:1788664213.581524:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140456960 00000100:00100000:3.0:1788664213.581557:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788664213.581563:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140456960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.581595:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140456960:12345-0@lo:400:kworker.0 Request processed in 33us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664213.581601:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788664213.581635:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140457216 00000100:00100000:3.0:1788664213.581638:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140457216 00000100:00100000:3.0:1788664213.581664:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788664213.581670:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9b4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140457216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.581709:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9b4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140457216:12345-0@lo:400:kworker.0 Request processed in 39us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664213.581714:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788664213.582704:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664213.582787:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140457344:0@lo:400:kworker.0 00000100:00100000:1.0:1788664213.582832:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140457728 00000100:00100000:1.0:1788664213.582837:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140457728 00000100:00100000:1.0:1788664213.582886:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140458240 00000100:00100000:1.0:1788664213.582889:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140458240 00000100:00100000:1.0:1788664213.582923:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140457856 00000100:00100000:1.0:1788664213.582926:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140457856 00000100:00100000:1.0:1788664213.582941:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788664213.582948:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140457728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664213.582996:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140457728:12345-0@lo:400:kworker.0 Request processed in 48us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664213.583003:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788664213.583017:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788664213.583023:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140458240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664213.583052:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140458240:12345-0@lo:400:kworker.0 Request processed in 29us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664213.583057:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788664213.583067:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788664213.583073:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140457856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664213.583102:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140457856:12345-0@lo:400:kworker.0 Request processed in 30us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664213.583108:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1788664213.583138:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303705500 x1875550140457856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664213.583223:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140457856:0@lo:400:kworker.0 00000100:00080000:3.0:1788664213.586206:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788664213.586217:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664213.586220:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664213.586223:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788664213.587469:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140456960:0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.587498:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140457472:0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.587510:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140457984:0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.587521:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140457088:0@lo:400:kworker.0 00010000:00080000:3.0:1788664213.587535:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303707b80 x1875550140457600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664213.587546:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140457600:0@lo:400:kworker.0 00010000:00080000:3.0:1788664213.587566:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303706300 x1875550140458112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664213.587593:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140458112:0@lo:400:kworker.0 00000100:00100000:3.0:1788664213.590717:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140457216:0@lo:400:kworker.0 00010000:00080000:3.0:1788664213.590740:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303706d80 x1875550140457728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664213.590752:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140457728:0@lo:400:kworker.0 00010000:00080000:3.0:1788664213.590766:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303704000 x1875550140458240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664213.590793:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140458240:0@lo:400:kworker.0 00010000:00010000:0.0:1788664213.951288:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664214.024842:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664214.025014:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119406976 00000100:00100000:3.0:1788664214.025027:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119406976 00000100:00100000:3.0:1788664214.025102:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 293 00000100:00100000:3.0:1788664214.025113:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:8705:x1875550119406976:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788664214.025135:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664214.025159:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4351eea00/0xcd11f61c1413d81a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d1ab expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664214.025209:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4351eea00/0xcd11f61c1413d81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1ab expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664214.025222:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4351eea00/0xcd11f61c1413d81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1ab expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664214.025233:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351eea00, rc 0) 00000100:00100000:3.0:1788664214.025345:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:8705:x1875550119406976:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 233us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664214.025378:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 293 00000100:00100000:1.0:1788664214.031572:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664214.031725:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119407104 00000100:00100000:3.0:1788664214.031739:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119407104 00000100:00100000:3.0:1788664214.031858:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 294 00000100:00100000:3.0:1788664214.031869:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:8705:x1875550119407104:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788664214.032092:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:8705:x1875550119407104:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 223us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664214.032100:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 294 00000100:00100000:1.0:1788664214.034414:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664214.034571:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119407232 00000100:00100000:0.0:1788664214.034585:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119407232 00000100:00100000:0.0:1788664214.034651:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 295 00000100:00100000:0.0:1788664214.034662:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c420ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:8705:x1875550119407232:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788664214.034948:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c420ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:8705:x1875550119407232:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 287us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664214.034967:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 295 00000100:00100000:2.0:1788664214.039241:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664214.039664:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119407360 00000100:00100000:0.0:1788664214.039678:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119407360 00000100:00100000:0.0:1788664214.039750:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 296 00000100:00100000:0.0:1788664214.039762:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c410474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:8709:x1875550119407360:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788664214.040036:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c410474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:8709:x1875550119407360:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 275us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664214.040045:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 296 00000100:00100000:2.0:1788664214.075459:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664214.075648:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119407488 00000100:00100000:3.0:1788664214.075663:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119407488 00000100:00100000:3.0:1788664214.075738:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 297 00000100:00100000:3.0:1788664214.075751:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c410475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:8709:x1875550119407488:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788664214.076001:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c410475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:8709:x1875550119407488:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 251us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664214.076011:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 297 00000100:00100000:1.0:1788664214.078724:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140458368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664214.078852:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664214.079127:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140458368 00000100:00100000:0.0:1788664214.079138:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140458368 00000100:00100000:0.0:1788664214.079208:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788664214.079219:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140458368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664214.079248:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664214.079313:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140458368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664214.079320:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1788664214.079485:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039c9180 x1875550140458368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664214.079509:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140458368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664214.085961:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664214.086386:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119407616 00000100:00100000:3.0:1788664214.086402:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119407616 00000100:00100000:3.0:1788664214.086490:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 298 00000100:00100000:3.0:1788664214.086502:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c421997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:8709:x1875550119407616:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788664214.086717:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c421997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:8709:x1875550119407616:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 216us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664214.086725:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 298 00000100:00100000:2.0:1788664214.089674:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664214.089762:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119407744 00000100:00100000:0.0:1788664214.089796:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119407744 00000100:00100000:0.0:1788664214.089862:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 299 00000100:00100000:0.0:1788664214.089875:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:8705:x1875550119407744:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788664214.089898:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664214.089925:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303957c00/0xcd11f61c1413d821 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d1dc expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664214.089963:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303957c00/0xcd11f61c1413d821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1dc expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664214.089999:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303957c00/0xcd11f61c1413d821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1dc expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664214.090011:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957c00, rc 0) 00000100:00100000:0.0:1788664214.090123:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:8705:x1875550119407744:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 250us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664214.090131:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 299 00000100:00100000:2.0:1788664214.095698:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664214.095809:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119407872 00000100:00100000:0.0:1788664214.095824:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119407872 00000100:00100000:0.0:1788664214.095900:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 300 00000100:00100000:0.0:1788664214.095913:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:8705:x1875550119407872:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788664214.095950:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788664214.095983:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788664214.095988:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788664214.095992:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788664214.095996:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788664214.095998:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788664214.100966:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:8705:x1875550119407872:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 5027us (5258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664214.100987:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 300 00000100:00100000:2.0:1788664214.108430:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664214.108602:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119408000 00000100:00100000:3.0:1788664214.108620:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119408000 00000100:00100000:3.0:1788664214.108727:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 301 00000100:00100000:3.0:1788664214.108739:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:8705:x1875550119408000:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788664214.108762:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664214.108817:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d828 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d1e3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664214.108857:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1e3 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664214.108871:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1e3 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664214.108883:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351ee200, rc 0) 00000100:00100000:3.0:1788664214.109386:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:8705:x1875550119408000:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 647us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664214.109395:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 301 00000100:00100000:2.0:1788664214.113417:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664214.113559:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119408128 00000100:00100000:0.0:1788664214.113573:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119408128 00000100:00100000:0.0:1788664214.113646:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 302 00000100:00100000:0.0:1788664214.113658:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:8705:x1875550119408128:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788664214.114684:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:8705:x1875550119408128:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 1021us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664214.114718:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 302 00000100:00100000:2.0:1788664214.117644:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664214.118032:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119408256 00000100:00100000:3.0:1788664214.118045:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119408256 00000100:00100000:3.0:1788664214.118161:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 303 00000100:00100000:3.0:1788664214.118173:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:8705:x1875550119408256:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788664214.118536:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:8705:x1875550119408256:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 364us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664214.118545:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 303 00000100:00100000:2.0:1788664214.124268:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664214.124472:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119408384 00000100:00100000:0.0:1788664214.124487:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119408384 00000100:00100000:0.0:1788664214.124558:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 304 00000100:00100000:0.0:1788664214.124570:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:8712:x1875550119408384:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788664214.124854:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:8712:x1875550119408384:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 283us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664214.124863:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 304 00000100:00100000:0.0:1788664214.147718:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664214.148159:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119408512 00000100:00100000:3.0:1788664214.148174:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119408512 00000100:00100000:3.0:1788664214.148386:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 305 00000100:00100000:3.0:1788664214.148398:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:8712:x1875550119408512:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788664214.149986:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:8712:x1875550119408512:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 1577us (2268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664214.150004:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 305 00000100:00100000:1.0:1788664214.162864:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664214.162927:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664214.162951:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664214.163168:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664214.178998:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119408640 00000100:00100000:0.0:1788664214.179023:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119408640 00000100:00100000:0.0:1788664214.179120:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119408896 00000100:00100000:0.0:1788664214.179125:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119408896 00000100:00100000:0.0:1788664214.179136:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119409280 00000100:00100000:0.0:1788664214.179140:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119409280 00000100:00100000:0.0:1788664214.179211:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119409408 00000100:00100000:0.0:1788664214.179215:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119409408 00000100:00100000:0.0:1788664214.179243:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 146 00000100:00100000:0.0:1788664214.179256:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2393:x1875550119409280:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664214.179394:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2393:x1875550119409280:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 139us (16439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664214.179404:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 146 00000100:00100000:0.0:1788664214.179751:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:0.0:1788664214.179762:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119409408:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664214.179830:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119409408:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 71us (16661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664214.179861:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:0.0:1788664214.179879:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1788664214.179885:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875550119408640:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788664214.179916:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc@192.168.203.52@tcp t0 exp 0000000000000000 cur 309 last 0 00000020:00000080:0.0:1788664214.180157:0:6512:0:(genops.c:1385:class_connect()) connect: client 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc, cookie 0xcd11f61c1413d82f 00000004:00100000:0.0:1788664214.180210:0:6512:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788664214.180370:0:6512:0:(import.c:65:import_set_state_nolock()) ffff93c4352e2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788664214.180410:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2389:x1875550119408640:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 523us (17562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664214.180417:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1788664214.180680:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1788664214.180687:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875550119408896:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788664214.180707:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc@192.168.203.52@tcp t0 exp 0000000000000000 cur 309 last 0 00000020:00000080:0.0:1788664214.180734:0:6512:0:(genops.c:1385:class_connect()) connect: client 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc, cookie 0xcd11f61c1413d836 00000004:00100000:0.0:1788664214.180893:0:6512:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788664214.182714:0:6512:0:(import.c:65:import_set_state_nolock()) ffff93c4352e2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788664214.184940:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2389:x1875550119408896:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 4233us (21994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664214.185116:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00080000:0.0:1788664214.185161:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788664214.185168:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664214.200027:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664214.200076:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664214.200166:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664214.200734:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119408768 00000100:00100000:0.0:1788664214.200753:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119408768 00000100:00100000:0.0:1788664214.200875:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119409152 00000100:00100000:0.0:1788664214.200879:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119409152 00000100:00100000:0.0:1788664214.200930:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119409024 00000100:00100000:0.0:1788664214.200933:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119409024 00000100:00100000:0.0:1788664214.200967:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1788664214.200978:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+7:0:x1875550119408768:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788664214.201033:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788664214.201147:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+7:0:x1875550119408768:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 170us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664214.201155:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1788664214.201186:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1788664214.201194:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:8705:x1875550119409152:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788664214.201205:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788664214.201231:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:8705:x1875550119409152:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 39us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664214.201237:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1788664214.201251:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1788664214.201258:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:0:x1875550119409024:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788664214.201294:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788664214.201335:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:0:x1875550119409024:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 77us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664214.201342:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00080000:1.0:1788664214.202118:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664214.202127:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664214.205262:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664214.205589:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119409536 00000100:00100000:1.0:1788664214.205604:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119409536 00000100:00100000:1.0:1788664214.205679:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1788664214.205692:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:8705:x1875550119409536:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788664214.205852:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:8705:x1875550119409536:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 162us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664214.205861:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1788664214.209682:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664214.209729:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664214.209854:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119409920 00000100:00100000:3.0:1788664214.209867:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119409920 00000100:00100000:3.0:1788664214.209936:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1788664214.209947:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:8705:x1875550119409920:12345-192.168.203.52@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788664214.210170:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664214.210461:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:8705:x1875550119409920:12345-192.168.203.52@tcp:900:mount.lustre.0 Request processed in 515us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664214.210470:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788664214.213890:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664214.214000:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119410048 00000100:00100000:2.0:1788664214.214014:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119410048 00000100:00100000:2.0:1788664214.214083:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1788664214.214095:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:8705:x1875550119410048:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788664214.214222:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788664214.214354:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:8705:x1875550119410048:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 260us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664214.214363:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:3.0:1788664214.220671:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119409664 00000100:00100000:3.0:1788664214.220695:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119409664 00000100:00100000:2.0:1788664214.221097:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119409792 00000100:00100000:2.0:1788664214.221103:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119409792 00000100:00100000:2.0:1788664214.221144:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1788664214.221155:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1875550119409664:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788664214.221227:0:8428:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc@192.168.203.52@tcp t0 exp 0000000000000000 cur 309 last 0 00000020:00000080:2.0:1788664214.221273:0:8428:0:(genops.c:1385:class_connect()) connect: client 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc, cookie 0xcd11f61c1413d83d 00002000:00100000:2.0:1788664214.221289:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc/ffff93c3029ff000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788664214.221316:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788664214.221603:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1788664214.221611:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1875550119409792:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788664214.221634:0:8429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc@192.168.203.52@tcp t0 exp 0000000000000000 cur 309 last 0 00000020:00000080:1.0:1788664214.221655:0:8429:0:(genops.c:1385:class_connect()) connect: client 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc, cookie 0xcd11f61c1413d844 00002000:00100000:1.0:1788664214.221660:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc/ffff93c302974800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788664214.221668:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788664214.221724:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788664214.221836:0:8429:0:(import.c:65:import_set_state_nolock()) ffff93c302972000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664214.221937:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2389:x1875550119409792:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 323us (11765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664214.221945:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00002000:00080000:2.0:1788664214.223919:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788664214.224329:0:8428:0:(import.c:65:import_set_state_nolock()) ffff93c3029f8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664214.225314:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2389:x1875550119409664:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 3284us (14707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664214.225333:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1788664214.594607:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140458496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788664214.594721:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664214.595592:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140458496 00000100:00100000:1.0:1788664214.595607:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140458496 00000100:00100000:1.0:1788664214.595681:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788664214.595693:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140458496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664214.595734:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788664214.595848:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140458496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664214.595855:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788664214.596710:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140458496:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788664214.976955:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664215.102630:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140458624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664215.102753:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664215.102920:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140458624 00000100:00100000:3.0:1788664215.102931:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140458624 00000100:00100000:3.0:1788664215.102999:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788664215.103011:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140458624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788664215.103048:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664215.103105:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140458624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664215.103112:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1788664215.103161:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42266a680 x1875550140458624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664215.103197:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140458624:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788664215.105061:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664215.105987:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664215.106024:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140458752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664215.106126:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664215.106389:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140458752 00000100:00100000:1.0:1788664215.106399:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140458752 00000100:00100000:1.0:1788664215.106507:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788664215.106517:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140458752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664215.106551:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664215.106613:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140458752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664215.106621:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788664215.107009:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788664215.107053:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350fc700 x1875550140458752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664215.107078:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140458752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788664215.999211:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664217.040761:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664218.046037:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664218.174184:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140458880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664218.174288:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664218.174557:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140458880 00000100:00100000:1.0:1788664218.174567:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140458880 00000100:00100000:1.0:1788664218.174632:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788664218.174644:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140458880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788664218.174697:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788664218.174752:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140458880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664218.174802:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788664218.175395:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140458880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664218.688010:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140459008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664218.688117:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664218.688218:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140459008 00000100:00100000:1.0:1788664218.688227:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140459008 00000100:00100000:1.0:1788664218.688293:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788664218.688303:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140459008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664218.688344:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664218.688398:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140459008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664218.688406:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788664218.688656:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788664218.688695:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c422668000 x1875550140459008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664218.688718:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140459008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664218.689142:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140459264:0@lo:400:kworker.0 00000100:00100000:0.0:1788664218.689204:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664218.689232:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140459776:0@lo:400:kworker.0 00000100:00100000:0.0:1788664218.689256:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664218.689283:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140460288:0@lo:400:kworker.0 00000100:00100000:0.0:1788664218.689304:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664218.689323:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788664218.689329:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140459392:0@lo:400:kworker.0 00000100:00100000:0.0:1788664218.689356:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664218.689376:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140459904:0@lo:400:kworker.0 00000100:00100000:0.0:1788664218.689401:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664218.689421:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140460416:0@lo:400:kworker.0 00000100:00100000:0.0:1788664218.689443:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664218.689474:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140459264 00000100:00100000:0.0:1788664218.689481:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140459264 00000100:00100000:0.0:1788664218.689524:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140459776 00000100:00100000:0.0:1788664218.689528:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140459776 00000100:00100000:0.0:1788664218.689557:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140460288 00000100:00100000:0.0:1788664218.689560:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140460288 00000100:00100000:0.0:1788664218.689576:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788664218.689583:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140459264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664218.689635:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140459264:12345-0@lo:400:kworker.0 Request processed in 52us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664218.689642:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788664218.689659:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788664218.689685:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140459776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664218.689715:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140459776:12345-0@lo:400:kworker.0 Request processed in 32us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664218.689722:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788664218.689734:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788664218.689739:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140460288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664218.689766:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140460288:12345-0@lo:400:kworker.0 Request processed in 27us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664218.689806:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788664218.689829:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140459392 00000100:00100000:0.0:1788664218.689833:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140459392 00000100:00100000:0.0:1788664218.689857:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788664218.689864:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140459392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664218.689898:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140459392:12345-0@lo:400:kworker.0 Request processed in 35us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664218.689904:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788664218.689964:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140459392:0@lo:400:kworker.0 00000100:00100000:0.0:1788664218.689975:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140459264:0@lo:400:kworker.0 00010000:00080000:0.0:1788664218.689986:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350fd880 x1875550140459776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664218.689996:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140459776:0@lo:400:kworker.0 00010000:00080000:0.0:1788664218.690005:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350fed80 x1875550140460288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664218.690012:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140460288:0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.690178:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140459904 00000100:00100000:3.0:1788664218.690184:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140459904 00000100:00100000:3.0:1788664218.690224:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140460416 00000100:00100000:3.0:1788664218.690228:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140460416 00000100:00100000:3.0:1788664218.690255:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788664218.690262:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140459904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.690309:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140459904:12345-0@lo:400:kworker.0 Request processed in 48us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664218.690315:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788664218.690329:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788664218.690335:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140460416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.690362:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140460416:12345-0@lo:400:kworker.0 Request processed in 28us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664218.690368:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788664218.690391:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140459520:0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.690423:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664218.690445:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140460032:0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.690467:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664218.690487:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788664218.690493:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140459136:0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.690521:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664218.690545:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140459648:0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.690566:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664218.690584:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140460160:0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.690619:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664218.690649:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140459136 00000100:00100000:3.0:1788664218.690653:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140459136 00000100:00100000:3.0:1788664218.690684:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788664218.690690:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140459136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.690725:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140459136:12345-0@lo:400:kworker.0 Request processed in 36us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664218.690731:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788664218.690761:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140459520 00000100:00100000:3.0:1788664218.690765:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140459520 00000100:00100000:3.0:1788664218.690812:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140459648 00000100:00100000:3.0:1788664218.690816:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140459648 00000100:00100000:3.0:1788664218.690829:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140460160 00000100:00100000:3.0:1788664218.690831:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140460160 00000100:00100000:3.0:1788664218.690843:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788664218.690848:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140459520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.690876:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140459520:12345-0@lo:400:kworker.0 Request processed in 28us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664218.690882:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788664218.690891:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788664218.690896:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140459648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.690933:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140459648:12345-0@lo:400:kworker.0 Request processed in 36us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664218.690938:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788664218.690948:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788664218.690953:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140460160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.690976:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140460160:12345-0@lo:400:kworker.0 Request processed in 23us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664218.690988:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788664218.691007:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140460032 00000100:00100000:3.0:1788664218.691011:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140460032 00000100:00100000:3.0:1788664218.691029:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788664218.691035:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140460032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.691061:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140460032:12345-0@lo:400:kworker.0 Request processed in 26us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664218.691066:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1788664218.691102:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350ffb80 x1875550140459904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664218.691116:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140459904:0@lo:400:kworker.0 00010000:00080000:3.0:1788664218.691126:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350fc380 x1875550140460416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664218.691134:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140460416:0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.691171:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140459136:0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.691180:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140459648:0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.691188:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140460160:0@lo:400:kworker.0 00000100:00100000:3.0:1788664218.691198:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140459520:0@lo:400:kworker.0 00010000:00080000:3.0:1788664218.691206:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350fc700 x1875550140460032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664218.691214:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140460032:0@lo:400:kworker.0 00000100:00080000:1.0:1788664218.691379:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788664218.691385:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664218.691388:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788664218.691390:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788664219.070542:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664219.198678:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140460544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788664219.198854:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664219.199011:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140460544 00000100:00100000:0.0:1788664219.199021:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140460544 00000100:00100000:0.0:1788664219.199083:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788664219.199094:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140460544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664219.199124:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664219.205027:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140460544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5917us (6156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664219.205048:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1788664219.207539:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039cad80 x1875550140460544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664219.207580:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140460544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664219.288332:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664219.288384:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664219.288410:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119410176 00000100:00100000:3.0:1788664219.288424:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119410176 00000100:00100000:2.0:1788664219.288430:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664219.288478:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664219.288530:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664219.296044:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 307 00000100:00100000:3.0:1788664219.296072:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119410176:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664219.296219:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119410176:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 159us (7904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664219.296228:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 307 00000100:00100000:3.0:1788664219.296283:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119410944 00000100:00100000:3.0:1788664219.296293:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119410944 00000100:00100000:3.0:1788664219.296347:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:3.0:1788664219.296353:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2390:x1875550119410944:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664219.296382:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2390:x1875550119410944:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (7905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664219.296388:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:2.0:1788664219.296565:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664219.296842:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119410432 00000100:00100000:1.0:1788664219.296847:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119410432 00000100:00100000:1.0:1788664219.296889:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119410688 00000100:00100000:1.0:1788664219.296893:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119410688 00000100:00100000:1.0:1788664219.296914:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119410304 00000100:00100000:1.0:1788664219.296917:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119410304 00000100:00100000:1.0:1788664219.296940:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00100000:1.0:1788664219.296949:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119410432:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664219.297006:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119410432:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 58us (8622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664219.297013:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00100000:1.0:1788664219.297029:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 155 00000100:00100000:1.0:1788664219.297035:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2390:x1875550119410688:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664219.297060:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2390:x1875550119410688:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (8632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664219.297066:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 155 00000100:00100000:1.0:1788664219.297076:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 156 00000100:00100000:1.0:1788664219.297093:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2390:x1875550119410304:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664219.297119:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2390:x1875550119410304:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (8588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664219.297125:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 156 00000100:00080000:1.0:1788664219.297182:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788664219.297188:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664219.297191:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664219.297374:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664219.297393:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119410560 00000100:00100000:1.0:1788664219.297398:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119410560 00000100:00100000:1.0:1788664219.297427:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 157 00000100:00100000:1.0:1788664219.297433:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2390:x1875550119410560:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664219.297466:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2390:x1875550119410560:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664219.297472:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 157 00000100:00080000:1.0:1788664219.297505:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664219.297538:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119410816 00000100:00100000:3.0:1788664219.297542:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119410816 00000100:00080000:1.0:1788664219.297584:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664219.297622:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:3.0:1788664219.297631:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2390:x1875550119410816:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664219.297676:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2390:x1875550119410816:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 47us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664219.297684:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:3.0:1788664219.710737:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664219.710799:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140460672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788664219.710896:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664219.712847:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140460672 00000100:00100000:2.0:1788664219.712868:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140460672 00000100:00100000:2.0:1788664219.712953:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788664219.712966:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140460672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788664219.713019:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788664219.713135:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140460672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 172us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664219.713154:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788664219.713225:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140460672:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1788664219.717643:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc 00000001:00100000:2.0:1788664219.718412:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc 00000001:00100000:2.0:1788664219.718827:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc 00000001:00100000:1.0:1788664219.719356:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc 00010000:00010000:0.0:1788664220.094045:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664220.222337:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664220.222361:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140460800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788664220.222428:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664220.224238:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140460800 00000100:00100000:1.0:1788664220.224253:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140460800 00000100:00100000:1.0:1788664220.224366:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788664220.224380:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140460800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788664220.224417:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664220.224505:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140460800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664220.224513:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788664220.224561:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c422668000 x1875550140460800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664220.224582:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140460800:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788664220.224693:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664220.225007:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140460928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664220.225049:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664220.225120:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140460928 00000100:00100000:3.0:1788664220.225126:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140460928 00000100:00100000:3.0:1788664220.225177:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788664220.225184:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140460928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788664220.225195:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788664220.225299:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664220.228344:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140460928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3151us (3284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664220.228359:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1788664220.228596:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e7b80 x1875550140460928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664220.228621:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140460928:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788664221.118511:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788664221.361656:0:12184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788664222.142016:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664223.166332:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664223.300047:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140461056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664223.300130:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664223.301819:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140461056 00000100:00100000:1.0:1788664223.301834:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140461056 00000100:00100000:1.0:1788664223.301909:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788664223.301919:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140461056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788664223.301954:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788664223.305790:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140461056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3845us (5632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664223.305826:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788664223.306400:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140461056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664223.809213:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140461184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664223.809294:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664223.809365:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140461184 00000100:00100000:1.0:1788664223.809373:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140461184 00000100:00100000:1.0:1788664223.809432:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788664223.809443:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140461184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664223.809479:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664223.809531:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140461184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664223.809539:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788664223.809562:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788664223.809593:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42266aa00 x1875550140461184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664223.809613:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140461184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664223.809746:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140461312:0@lo:400:kworker.0 00000100:00100000:1.0:1788664223.809802:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664223.809829:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140461824:0@lo:400:kworker.0 00000100:00100000:1.0:1788664223.809858:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664223.809880:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140462336:0@lo:400:kworker.0 00000100:00100000:1.0:1788664223.809903:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664223.809924:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788664223.809930:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140461440:0@lo:400:kworker.0 00000100:00100000:1.0:1788664223.809951:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664223.811094:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140461824 00000100:00100000:2.0:1788664223.811108:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140461824 00000100:00100000:2.0:1788664223.811195:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140462336 00000100:00100000:2.0:1788664223.811199:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140462336 00000100:00100000:2.0:1788664223.811226:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788664223.811235:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c435358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140461824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664223.811316:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c435358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140461824:12345-0@lo:400:kworker.0 Request processed in 82us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664223.811324:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788664223.811814:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788664223.811823:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c435359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140462336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664223.811863:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c435359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140462336:12345-0@lo:400:kworker.0 Request processed in 42us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664223.811869:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788664223.811896:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140461312 00000100:00100000:2.0:1788664223.811901:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140461312 00000100:00100000:2.0:1788664223.811942:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788664223.812230:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140461312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664223.812266:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140461312:12345-0@lo:400:kworker.0 Request processed in 40us (2464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664223.812272:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788664223.812326:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140461568:0@lo:400:kworker.0 00000100:00100000:2.0:1788664223.812374:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664223.812548:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140462080:0@lo:400:kworker.0 00000100:00100000:1.0:1788664223.812548:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140461952:0@lo:400:kworker.0 00000100:00100000:2.0:1788664223.812589:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664223.812595:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664223.812619:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43535aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140462592:0@lo:400:kworker.0 00000100:00100000:1.0:1788664223.812624:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43535b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140462464:0@lo:400:kworker.0 00000100:00100000:2.0:1788664223.812651:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664223.812661:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664223.812696:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140461312:0@lo:400:kworker.0 00000100:00100000:1.0:1788664223.812710:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140461824:0@lo:400:kworker.0 00000100:00100000:1.0:1788664223.812731:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140462336:0@lo:400:kworker.0 00000100:00100000:1.0:1788664223.812764:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140461440 00000100:00100000:1.0:1788664223.812784:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140461440 00000100:00100000:1.0:1788664223.812815:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140461952 00000100:00100000:1.0:1788664223.812818:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140461952 00000100:00100000:1.0:1788664223.812833:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140462464 00000100:00100000:1.0:1788664223.812836:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140462464 00000100:00100000:2.0:1788664223.813093:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788664223.813102:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140461696:0@lo:400:kworker.0 00000100:00100000:2.0:1788664223.813142:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664223.813156:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140462208:0@lo:400:kworker.0 00000100:00100000:2.0:1788664223.813181:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664223.813210:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140461568 00000100:00100000:2.0:1788664223.813215:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140461568 00000100:00100000:2.0:1788664223.813245:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788664223.813252:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140461568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664223.813303:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140461568:12345-0@lo:400:kworker.0 Request processed in 47us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664223.813310:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788664223.813334:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140462080 00000100:00100000:2.0:1788664223.813338:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140462080 00000100:00100000:2.0:1788664223.813365:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140462592 00000100:00100000:2.0:1788664223.813368:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140462592 00000100:00100000:1.0:1788664223.813510:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140461696 00000100:00100000:1.0:1788664223.813514:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140461696 00000100:00100000:1.0:1788664223.813530:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788664223.813537:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140461440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664223.813579:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140461440:12345-0@lo:400:kworker.0 Request processed in 43us (3627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664223.813586:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788664223.813598:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788664223.813604:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c435358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140461952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664223.813633:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c435358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140461952:12345-0@lo:400:kworker.0 Request processed in 29us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664223.813639:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788664223.813649:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788664223.813662:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140462464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664223.813692:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140462464:12345-0@lo:400:kworker.0 Request processed in 31us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664223.813698:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788664223.813710:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788664223.813725:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140461696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664223.813754:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140461696:12345-0@lo:400:kworker.0 Request processed in 39us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664223.813761:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788664223.813794:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140462208 00000100:00100000:2.0:1788664223.813799:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140462208 00000100:00080000:1.0:1788664223.813804:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664223.813810:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788664223.813814:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664223.813817:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664223.813822:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788664223.813831:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140462080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664223.813870:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140462080:12345-0@lo:400:kworker.0 Request processed in 40us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664223.813877:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788664223.813889:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788664223.813895:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140462592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664223.813936:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140462592:12345-0@lo:400:kworker.0 Request processed in 41us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664223.813942:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788664223.814004:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140461440:0@lo:400:kworker.0 00010000:00080000:1.0:1788664223.814020:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42266a680 x1875550140461952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664223.814032:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140461952:0@lo:400:kworker.0 00010000:00080000:1.0:1788664223.814043:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43535b800 x1875550140462464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664223.814051:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43535b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140462464:0@lo:400:kworker.0 00000100:00100000:2.0:1788664223.814090:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788664223.814100:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140462208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664223.814146:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140462208:12345-0@lo:400:kworker.0 Request processed in 48us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664223.814153:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788664223.814214:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140461696:0@lo:400:kworker.0 00010000:00080000:2.0:1788664223.814228:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303706680 x1875550140462208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664223.814237:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140462208:0@lo:400:kworker.0 00000100:00100000:2.0:1788664223.814249:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140461568:0@lo:400:kworker.0 00010000:00080000:2.0:1788664223.814259:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303704e00 x1875550140462080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664223.814266:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140462080:0@lo:400:kworker.0 00010000:00080000:2.0:1788664223.814288:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43535aa00 x1875550140462592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664223.814295:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43535aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140462592:0@lo:400:kworker.0 00010000:00010000:3.0:1788664224.189941:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664224.319141:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140462720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788664224.319208:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664224.320852:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140462720 00000100:00100000:2.0:1788664224.320863:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140462720 00000100:00100000:2.0:1788664224.320910:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788664224.320920:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140462720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788664224.320944:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664224.326332:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140462720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5405us (7115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664224.326348:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1788664224.326927:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039cb480 x1875550140462720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664224.326951:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140462720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664224.406309:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664224.406346:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664224.406385:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664224.406410:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664224.406430:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664224.406448:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664224.406481:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664224.406513:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119411328 00000100:00100000:2.0:1788664224.406523:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119411328 00000100:00100000:2.0:1788664224.406580:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119411584 00000100:00100000:2.0:1788664224.406584:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119411584 00000100:00100000:2.0:1788664224.406597:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119411200 00000100:00100000:2.0:1788664224.406611:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119411200 00000100:00100000:2.0:1788664224.406626:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119411456 00000100:00100000:2.0:1788664224.406628:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119411456 00000100:00100000:2.0:1788664224.406644:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:2.0:1788664224.406653:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119411328:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664224.406746:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119411328:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 93us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664224.406754:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:2.0:1788664224.406804:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:2.0:1788664224.406811:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119411584:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664224.406837:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119411584:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664224.406843:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:2.0:1788664224.406858:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00100000:2.0:1788664224.406864:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119411200:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664224.406887:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119411200:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664224.406892:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00100000:2.0:1788664224.406903:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:2.0:1788664224.406909:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119411456:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664224.406932:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119411456:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664224.406938:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:2.0:1788664224.406957:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119411840 00000100:00100000:2.0:1788664224.406960:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119411840 00000100:00100000:2.0:1788664224.406984:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119411712 00000100:00100000:2.0:1788664224.406987:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119411712 00000100:00100000:2.0:1788664224.407005:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:2.0:1788664224.407012:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119411840:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664224.407045:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119411840:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 33us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664224.407051:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:2.0:1788664224.407063:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:2.0:1788664224.407069:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119411712:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664224.407090:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119411712:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 22us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664224.407096:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:3.0:1788664224.407411:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119411072 00000100:00100000:3.0:1788664224.407417:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119411072 00000100:00100000:3.0:1788664224.407446:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 309 00000100:00100000:3.0:1788664224.407452:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2391:x1875550119411072:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664224.407495:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2391:x1875550119411072:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 43us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664224.407502:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 309 00000100:00080000:0.0:1788664224.408906:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788664224.408914:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664224.408917:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664224.408920:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788664224.830559:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140462848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664224.830628:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664224.830698:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140462848 00000100:00100000:1.0:1788664224.830705:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140462848 00000100:00100000:1.0:1788664224.830752:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788664224.830794:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140462848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664224.830828:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788664224.830872:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140462848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664224.830879:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788664224.830922:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140462848:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788664225.217632:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664225.342010:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664225.342033:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140462976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788664225.342100:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664225.342185:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140462976 00000100:00100000:1.0:1788664225.342192:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140462976 00000100:00100000:1.0:1788664225.342243:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788664225.342253:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140462976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788664225.342285:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664225.342328:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140462976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664225.342335:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788664225.342356:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788664225.342386:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039d6300 x1875550140462976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664225.342402:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140462976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664225.342595:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664225.342608:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140463104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664225.342639:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664225.342700:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140463104 00000100:00100000:0.0:1788664225.342704:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140463104 00000100:00100000:0.0:1788664225.342744:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788664225.342750:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140463104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664225.342761:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664225.342817:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140463104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664225.342824:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788664225.342875:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788664225.342896:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e4700 x1875550140463104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664225.342910:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140463104:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788664226.242148:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664227.262746:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664228.286247:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664228.418377:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140463232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664228.418482:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664228.418617:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140463232 00000100:00100000:0.0:1788664228.418629:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140463232 00000100:00100000:0.0:1788664228.418710:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788664228.418721:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140463232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788664228.418802:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788664228.418890:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140463232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 170us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664228.418898:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788664228.418955:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140463232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664228.929313:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788664228.929334:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140463360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664228.929401:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664228.929465:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140463360 00000100:00100000:3.0:1788664228.929472:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140463360 00000100:00100000:3.0:1788664228.929526:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788664228.929536:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140463360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664228.929567:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664228.929881:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140463360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 346us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664228.929889:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788664228.929909:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788664228.929939:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3035a4a80 x1875550140463360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664228.929957:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140463360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664228.937187:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140463616:0@lo:400:kworker.0 00000100:00100000:2.0:1788664228.937278:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664228.937327:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140464128:0@lo:400:kworker.0 00000100:00100000:2.0:1788664228.937350:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664228.937394:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140464640:0@lo:400:kworker.0 00000100:00100000:2.0:1788664228.937416:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664228.937443:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788664228.937448:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140463744:0@lo:400:kworker.0 00000100:00100000:2.0:1788664228.937474:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664228.937493:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140464256:0@lo:400:kworker.0 00000100:00100000:2.0:1788664228.937514:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664228.937530:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140464768:0@lo:400:kworker.0 00000100:00100000:2.0:1788664228.937562:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664228.937917:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140463488:0@lo:400:kworker.0 00000100:00100000:1.0:1788664228.937953:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664228.937979:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140464000:0@lo:400:kworker.0 00000100:00100000:1.0:1788664228.938012:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664228.938045:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140464512:0@lo:400:kworker.0 00000100:00100000:1.0:1788664228.938088:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664228.938108:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788664228.938114:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140463872:0@lo:400:kworker.0 00000100:00100000:1.0:1788664228.938136:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664228.938147:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140464384:0@lo:400:kworker.0 00000100:00100000:1.0:1788664228.938165:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664228.938181:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140464896:0@lo:400:kworker.0 00000100:00100000:1.0:1788664228.938201:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664228.938229:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140463744 00000100:00100000:1.0:1788664228.938236:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140463744 00000100:00100000:1.0:1788664228.938275:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140464000 00000100:00100000:1.0:1788664228.938278:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140464000 00000100:00100000:1.0:1788664228.938294:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788664228.938301:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140463744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664228.938361:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140463744:12345-0@lo:400:kworker.0 Request processed in 59us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664228.938368:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788664228.938385:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788664228.938391:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140464000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664228.938421:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140464000:12345-0@lo:400:kworker.0 Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664228.938427:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788664228.938464:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140464000:0@lo:400:kworker.0 00000100:00100000:2.0:1788664228.941766:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140463616 00000100:00100000:2.0:1788664228.941808:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140463616 00000100:00100000:2.0:1788664228.941860:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140464128 00000100:00100000:2.0:1788664228.941863:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140464128 00000100:00100000:2.0:1788664228.941891:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140464640 00000100:00100000:2.0:1788664228.941894:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140464640 00000100:00100000:2.0:1788664228.941907:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140464256 00000100:00100000:2.0:1788664228.941909:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140464256 00000100:00100000:2.0:1788664228.941920:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140464768 00000100:00100000:2.0:1788664228.941923:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140464768 00000100:00100000:2.0:1788664228.941935:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140463872 00000100:00100000:2.0:1788664228.941938:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140463872 00000100:00100000:2.0:1788664228.941953:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788664228.941962:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140463616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664228.942061:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140463616:12345-0@lo:400:kworker.0 Request processed in 100us (4782us total) trans 0 rc 0/0 00000100:00080000:0.0:1788664228.942298:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788664228.942304:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664228.942854:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788664228.942869:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140464128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664228.942925:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140464128:12345-0@lo:400:kworker.0 Request processed in 62us (5574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664228.942932:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788664228.942955:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788664228.942961:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140464640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664228.942988:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140464640:12345-0@lo:400:kworker.0 Request processed in 28us (5571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664228.942995:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788664228.943007:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788664228.943014:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140464256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664228.943044:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140464256:12345-0@lo:400:kworker.0 Request processed in 31us (5528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664228.943050:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788664228.943061:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788664228.944797:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788664228.944836:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788664228.944850:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140463872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664228.944939:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140463872:12345-0@lo:400:kworker.0 Request processed in 95us (6801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664228.944945:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788664228.944967:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140463488 00000100:00100000:2.0:1788664228.944975:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140463488 00000100:00100000:2.0:1788664228.945011:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788664228.945018:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140463488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664228.945051:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140463488:12345-0@lo:400:kworker.0 Request processed in 34us (7097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664228.945057:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788664228.945102:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140464512 00000100:00100000:2.0:1788664228.945113:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140464512 00000100:00100000:2.0:1788664228.945150:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140464384 00000100:00100000:2.0:1788664228.945153:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140464384 00000100:00100000:2.0:1788664228.945166:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140464896 00000100:00100000:2.0:1788664228.945168:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140464896 00000100:00100000:2.0:1788664228.945181:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788664228.945186:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140464512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664228.945219:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140464512:12345-0@lo:400:kworker.0 Request processed in 32us (7131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664228.945225:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788664228.945247:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788664228.945254:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140464384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664228.945283:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140464384:12345-0@lo:400:kworker.0 Request processed in 30us (7116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664228.945289:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788664228.945299:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788664228.945305:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140464896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664228.945336:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140464896:12345-0@lo:400:kworker.0 Request processed in 31us (7134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664228.945341:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788664228.945563:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140464768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664228.945601:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140464768:12345-0@lo:400:kworker.0 Request processed in 2535us (8038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664228.945617:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1788664228.945652:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664228.945656:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664228.946570:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140463744:0@lo:400:kworker.0 00010000:00080000:3.0:1788664228.946605:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3036fb480 x1875550140464256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664228.946615:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140464256:0@lo:400:kworker.0 00010000:00080000:3.0:1788664228.946626:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3036f9500 x1875550140464768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664228.946635:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140464768:0@lo:400:kworker.0 00000100:00100000:3.0:1788664228.946645:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140463616:0@lo:400:kworker.0 00000100:00100000:3.0:1788664228.946655:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140464128:0@lo:400:kworker.0 00000100:00100000:3.0:1788664228.946665:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140464640:0@lo:400:kworker.0 00000100:00100000:1.0:1788664228.946960:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140463872:0@lo:400:kworker.0 00010000:00080000:1.0:1788664228.946972:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3036fb800 x1875550140464384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664228.946988:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140464384:0@lo:400:kworker.0 00010000:00080000:1.0:1788664228.947000:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3036f8a80 x1875550140464896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664228.947006:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140464896:0@lo:400:kworker.0 00000100:00100000:1.0:1788664228.947015:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140463488:0@lo:400:kworker.0 00010000:00080000:1.0:1788664228.947025:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3036f8000 x1875550140464512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664228.947032:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140464512:0@lo:400:kworker.0 00010000:00010000:0.0:1788664229.312647:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664229.438095:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664229.438120:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140465024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664229.438195:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664229.438345:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140465024 00000100:00100000:2.0:1788664229.438353:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140465024 00000100:00100000:2.0:1788664229.438416:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788664229.438426:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140465024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788664229.438448:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664229.438502:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140465024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664229.438525:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1788664229.438846:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b45c00 x1875550140465024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664229.438866:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140465024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664229.529624:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664229.529677:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664229.529701:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664229.529729:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664229.529747:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664229.529761:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664229.529805:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664229.529830:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119412736 00000100:00100000:2.0:1788664229.529839:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119412736 00000100:00100000:2.0:1788664229.529892:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119412608 00000100:00100000:2.0:1788664229.529895:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119412608 00000100:00100000:2.0:1788664229.529916:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:2.0:1788664229.529925:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119412736:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664229.530008:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119412736:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 84us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664229.530016:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:2.0:1788664229.530032:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:2.0:1788664229.530039:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119412608:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664229.530067:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119412608:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 28us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664229.530072:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:0.0:1788664229.530263:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119412224 00000100:00100000:0.0:1788664229.530267:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119412224 00000100:00100000:0.0:1788664229.530300:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119412480 00000100:00100000:0.0:1788664229.530303:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119412480 00000100:00100000:0.0:1788664229.530316:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119412096 00000100:00100000:0.0:1788664229.530319:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119412096 00000100:00100000:0.0:1788664229.530329:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119412352 00000100:00100000:0.0:1788664229.530332:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119412352 00000100:00100000:0.0:1788664229.530344:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 174 00000100:00100000:0.0:1788664229.530350:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119412224:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664229.530389:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119412224:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 38us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664229.530395:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 174 00000100:00100000:0.0:1788664229.530419:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 175 00000100:00100000:0.0:1788664229.530426:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119412480:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664229.530451:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119412480:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664229.530473:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 175 00000100:00100000:0.0:1788664229.530485:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 176 00000100:00100000:0.0:1788664229.530490:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2390:x1875550119412096:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664229.530516:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2390:x1875550119412096:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664229.530521:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 176 00000100:00100000:0.0:1788664229.530530:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 177 00000100:00100000:0.0:1788664229.530536:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119412352:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664229.530557:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119412352:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 21us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664229.530563:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 177 00000100:00080000:0.0:1788664229.530584:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664229.530588:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788664229.530590:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788664229.530591:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664229.531596:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119411968 00000100:00100000:3.0:1788664229.531605:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119411968 00000100:00100000:3.0:1788664229.531676:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 311 00000100:00100000:3.0:1788664229.531685:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119411968:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664229.531749:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119411968:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 65us (2134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664229.531756:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 311 00000100:00100000:1.0:1788664229.954952:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664229.954976:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140465152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664229.955047:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664229.955168:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140465152 00000100:00100000:2.0:1788664229.955177:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140465152 00000100:00100000:2.0:1788664229.955229:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788664229.955239:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140465152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788664229.955291:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788664229.955358:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140465152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664229.955364:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788664229.955406:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140465152:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788664230.338433:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664230.462625:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664230.462651:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140465280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788664230.462722:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664230.462899:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140465280 00000100:00100000:0.0:1788664230.462908:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140465280 00000100:00100000:0.0:1788664230.462969:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788664230.462979:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140465280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788664230.463009:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664230.463056:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140465280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664230.463064:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1788664230.463213:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788664230.463241:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e6a00 x1875550140465280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664230.463258:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140465280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664230.467215:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140465408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664230.467281:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664230.467362:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140465408 00000100:00100000:0.0:1788664230.467370:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140465408 00000100:00100000:0.0:1788664230.467423:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788664230.467430:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140465408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664230.467452:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664230.467492:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140465408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664230.467500:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1788664230.467518:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788664230.467544:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e6a00 x1875550140465408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664230.467562:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140465408:0@lo:13:osp-pre-0-0.0 00000020:00000004:1.0:1788664230.626354:0:12500:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788664230.626567:0:12500:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788664231.358032:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664232.382144:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788664233.295036:0:12598:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788664233.295309:0:12598:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788664233.407697:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664233.543116:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140465536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664233.543187:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664233.544190:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140465536 00000100:00100000:1.0:1788664233.544209:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140465536 00000100:00100000:1.0:1788664233.544268:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788664233.544277:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140465536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788664233.544316:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788664233.544390:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140465536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664233.544398:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788664233.544545:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140465536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664234.046843:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664234.046866:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140465664:0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.046933:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664234.047007:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140465792:0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.047035:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664234.047082:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140465792 00000100:00100000:1.0:1788664234.047089:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140465792 00000100:00100000:1.0:1788664234.047135:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788664234.047144:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140465792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.047192:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140465792:12345-0@lo:400:kworker.0 Request processed in 49us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664234.047199:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788664234.047239:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140465792:0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.047280:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140465920:0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.047321:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664234.047350:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140465920 00000100:00100000:1.0:1788664234.047354:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140465920 00000100:00100000:1.0:1788664234.047377:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788664234.047383:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140465920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.047430:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140465920:12345-0@lo:400:kworker.0 Request processed in 47us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664234.047436:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788664234.047461:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140465920:0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.047484:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664234.047737:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140465664 00000100:00100000:3.0:1788664234.047742:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140465664 00000100:00100000:3.0:1788664234.047791:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788664234.047798:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140465664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664234.047848:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140465664:12345-0@lo:400:kworker.0 Request processed in 51us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664234.047855:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788664234.051337:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140466048:0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.051404:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664234.051461:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140466048 00000100:00100000:1.0:1788664234.051467:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140466048 00000100:00100000:1.0:1788664234.051561:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788664234.051569:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140466048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.051714:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140466048:12345-0@lo:400:kworker.0 Request processed in 145us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664234.051722:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788664234.051766:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140465664:0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.051798:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664234.051806:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140466176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664234.051834:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664234.051862:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140466176 00000100:00100000:1.0:1788664234.051866:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140466176 00000100:00100000:1.0:1788664234.051901:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788664234.051907:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140466176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664234.051929:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664234.051964:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140466176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664234.051982:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788664234.051999:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788664234.052022:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3035a4a80 x1875550140466176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664234.052041:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140466176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664234.052082:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140466048:0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.052122:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140466304:0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.052147:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664234.052175:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140466304 00000100:00100000:1.0:1788664234.052179:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140466304 00000100:00100000:1.0:1788664234.052209:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788664234.052215:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140466304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.052252:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140466304:12345-0@lo:400:kworker.0 Request processed in 38us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664234.052257:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788664234.052282:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140466304:0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.052322:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140466432:0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.052345:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664234.052381:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664234.052387:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140466560:0@lo:400:kworker.0 00000100:00100000:1.0:1788664234.052407:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664234.052430:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140466432 00000100:00100000:1.0:1788664234.052433:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140466432 00000100:00100000:1.0:1788664234.052457:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140466560 00000100:00100000:1.0:1788664234.052467:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140466560 00000100:00080000:0.0:1788664234.052866:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788664234.052870:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664234.052900:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140466688:0@lo:400:kworker.0 00000100:00100000:0.0:1788664234.052936:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664234.052979:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664234.052986:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140466816:0@lo:400:kworker.0 00000100:00100000:0.0:1788664234.053007:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664234.053072:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140467200:0@lo:400:kworker.0 00000100:00100000:0.0:1788664234.053095:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664234.053140:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788664234.053150:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140466432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664234.053192:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140466432:12345-0@lo:400:kworker.0 Request processed in 46us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664234.053200:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788664234.053215:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788664234.053221:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140466560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664234.053246:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140466560:12345-0@lo:400:kworker.0 Request processed in 25us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664234.053251:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788664234.053288:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140466944:0@lo:400:kworker.0 00000100:00100000:0.0:1788664234.053329:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788664234.053358:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42266a300 x1875550140466560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664234.053370:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140466560:0@lo:400:kworker.0 00000100:00100000:0.0:1788664234.053381:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140466432:0@lo:400:kworker.0 00000100:00100000:0.0:1788664234.053395:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664234.053400:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140467072:0@lo:400:kworker.0 00000100:00100000:0.0:1788664234.053422:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664234.053444:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140466944 00000100:00100000:0.0:1788664234.053449:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140466944 00000100:00100000:0.0:1788664234.053477:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140467072 00000100:00100000:0.0:1788664234.053481:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140467072 00000100:00100000:0.0:1788664234.053508:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788664234.053514:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140466944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664234.053543:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140466944:12345-0@lo:400:kworker.0 Request processed in 30us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664234.053558:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788664234.053571:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788664234.053575:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140467072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664234.053866:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140467072:12345-0@lo:400:kworker.0 Request processed in 289us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664234.053873:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:0.0:1788664234.053892:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788664234.053895:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788664234.053912:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350fd180 x1875550140467072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664234.053922:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140467072:0@lo:400:kworker.0 00000100:00100000:0.0:1788664234.053932:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140466944:0@lo:400:kworker.0 00000100:00100000:2.0:1788664234.054034:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140466688 00000100:00100000:2.0:1788664234.054039:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140466688 00000100:00100000:2.0:1788664234.054090:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140466816 00000100:00100000:2.0:1788664234.054093:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140466816 00000100:00100000:2.0:1788664234.054106:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140467200 00000100:00100000:2.0:1788664234.054108:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140467200 00000100:00100000:2.0:1788664234.054121:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788664234.054127:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140466688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664234.054168:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140466688:12345-0@lo:400:kworker.0 Request processed in 41us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664234.054174:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788664234.054186:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788664234.054193:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140466816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664234.054219:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140466816:12345-0@lo:400:kworker.0 Request processed in 28us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664234.054225:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788664234.054237:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788664234.054243:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140467200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664234.054270:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140467200:12345-0@lo:400:kworker.0 Request processed in 27us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664234.054283:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1788664234.054322:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350fdf80 x1875550140467200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664234.054332:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140467200:0@lo:400:kworker.0 00010000:00080000:2.0:1788664234.054343:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350fc700 x1875550140466816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664234.054351:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140466816:0@lo:400:kworker.0 00010000:00080000:2.0:1788664234.054360:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e5c00 x1875550140466688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664234.054369:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140466688:0@lo:400:kworker.0 00000100:00080000:0.0:1788664234.058563:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664234.058574:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788664234.430391:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664234.558189:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664234.558217:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140467328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788664234.558676:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664234.558915:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140467328 00000100:00100000:2.0:1788664234.558923:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140467328 00000100:00100000:2.0:1788664234.558977:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788664234.558986:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140467328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788664234.559010:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664234.559064:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140467328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664234.559071:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1788664234.559179:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b46300 x1875550140467328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664234.559199:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140467328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664234.660506:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664234.660601:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664234.660692:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664234.661128:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119412864 00000100:00100000:2.0:1788664234.661140:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119412864 00000100:00100000:2.0:1788664234.661194:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 313 00000100:00100000:2.0:1788664234.661205:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2393:x1875550119412864:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664234.661280:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2393:x1875550119412864:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 77us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664234.661305:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 313 00000100:00100000:0.0:1788664234.661567:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664234.661879:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119413120 00000100:00100000:3.0:1788664234.661885:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119413120 00000100:00100000:3.0:1788664234.661936:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119413376 00000100:00100000:3.0:1788664234.661940:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119413376 00000100:00100000:3.0:1788664234.662172:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:3.0:1788664234.662182:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119413120:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664234.662231:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119413120:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 51us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664234.662238:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:3.0:1788664234.662252:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:3.0:1788664234.662258:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119413376:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664234.662282:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119413376:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664234.662288:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:0.0:1788664234.662438:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664234.662942:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664234.662983:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00080000:0.0:1788664234.663003:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664234.663058:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119412992 00000100:00100000:2.0:1788664234.663065:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119412992 00000100:00100000:2.0:1788664234.663101:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119413248 00000100:00100000:2.0:1788664234.663104:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119413248 00000100:00100000:2.0:1788664234.663119:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 186 00000100:00100000:2.0:1788664234.663126:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2393:x1875550119412992:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664234.663169:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2393:x1875550119412992:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 43us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664234.663176:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 186 00000100:00100000:2.0:1788664234.663191:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:2.0:1788664234.663197:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119413248:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664234.663221:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119413248:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664234.663228:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00080000:2.0:1788664234.663245:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664234.664397:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119413504 00000100:00100000:0.0:1788664234.664407:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119413504 00000100:00100000:0.0:1788664234.664488:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119413632 00000100:00100000:0.0:1788664234.664491:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119413632 00000100:00100000:3.0:1788664234.664541:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:3.0:1788664234.664555:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2389:x1875550119413504:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:3.0:1788664234.664579:0:9895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d83d 00000100:00080000:3.0:1788664234.664591:0:9895:0:(import.c:65:import_set_state_nolock()) ffff93c3029f8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788664234.664633:0:9895:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788664234.665130:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+2:2389:x1875550119413504:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 575us (2186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664234.665139:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00080000:2.0:1788664234.665193:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664234.665197:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664234.665287:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1788664234.665296:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2389:x1875550119413632:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:0.0:1788664234.665310:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d844 00000100:00080000:0.0:1788664234.665315:0:8426:0:(import.c:65:import_set_state_nolock()) ffff93c302972000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788664234.665345:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788664234.665432:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+2:2389:x1875550119413632:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 137us (2447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664234.665439:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00010000:00010000:0.0:1788664234.665458:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664234.665603:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664235.070939:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664235.070964:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140467456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664235.071047:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664235.071143:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140467456 00000100:00100000:2.0:1788664235.071151:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140467456 00000100:00100000:2.0:1788664235.071202:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788664235.071211:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140467456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788664235.071246:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788664235.071310:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140467456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664235.071331:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788664235.071484:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140467456:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788664235.453989:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664235.582145:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664235.582176:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140467584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664235.582257:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664235.582558:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140467584 00000100:00100000:1.0:1788664235.582567:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140467584 00000100:00100000:1.0:1788664235.582631:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788664235.582641:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140467584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788664235.582670:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664235.582718:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140467584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664235.582725:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1788664235.582765:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c422669180 x1875550140467584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664235.582811:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140467584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664235.588472:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140467712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664235.592707:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664235.592933:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140467712 00000100:00100000:1.0:1788664235.592941:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140467712 00000100:00100000:1.0:1788664235.592993:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788664235.593004:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140467712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664235.593029:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664235.593092:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140467712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664235.593100:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1788664235.593134:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c422669180 x1875550140467712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664235.593168:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140467712:0@lo:13:osp-pre-0-0.0 00000020:00000004:1.0:1788664235.635378:0:12695:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788664235.636030:0:12695:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788664236.477989:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664237.505457:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788664238.016744:0:12792:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788664238.018545:0:12792:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788664238.525951:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664238.654242:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664238.654273:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140467840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664238.654342:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664238.654468:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140467840 00000100:00100000:1.0:1788664238.654476:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140467840 00000100:00100000:1.0:1788664238.654524:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788664238.654532:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140467840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788664238.654563:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788664238.654618:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140467840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664238.654625:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788664238.654826:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140467840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664239.166028:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140467968:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.166106:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664239.166147:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140468480:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.166171:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664239.166187:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140468992:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.166207:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664239.166222:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140469504:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.166238:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664239.166259:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788664239.166264:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140468096:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.166283:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664239.166297:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140468608:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.166313:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664239.166334:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140469120:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.166354:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664239.166368:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140469632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664239.166386:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664239.166410:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140468224:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.166432:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664239.166448:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140468736:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.167802:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664239.168267:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140469248:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.168303:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664239.168332:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788664239.168339:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140468352:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.168364:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664239.168376:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140468864:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.168398:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664239.168413:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140469376:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.168430:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664239.168496:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140467968 00000100:00100000:1.0:1788664239.168504:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140467968 00000100:00100000:1.0:1788664239.168548:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788664239.168555:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140467968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.168623:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140467968:12345-0@lo:400:kworker.0 Request processed in 68us (2517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664239.168629:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788664239.168660:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140468480 00000100:00100000:1.0:1788664239.168677:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140468480 00000100:00100000:1.0:1788664239.168701:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140468224 00000100:00100000:1.0:1788664239.168704:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140468224 00000100:00100000:1.0:1788664239.168733:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788664239.168739:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140468480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.168796:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140468480:12345-0@lo:400:kworker.0 Request processed in 57us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664239.168802:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788664239.168814:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788664239.168819:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140468224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.168860:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140468224:12345-0@lo:400:kworker.0 Request processed in 40us (2426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664239.168866:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788664239.168881:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140468992 00000100:00100000:1.0:1788664239.168884:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140468992 00000100:00100000:1.0:1788664239.168910:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140469504 00000100:00100000:1.0:1788664239.168912:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140469504 00000100:00100000:1.0:1788664239.168922:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140468864 00000100:00100000:1.0:1788664239.168924:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140468864 00000100:00100000:1.0:1788664239.168932:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140469376 00000100:00100000:1.0:1788664239.168934:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140469376 00000100:00100000:1.0:1788664239.168944:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788664239.168950:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140468992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.168975:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140468992:12345-0@lo:400:kworker.0 Request processed in 26us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664239.168980:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788664239.168990:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788664239.168994:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140469504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.169043:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140469504:12345-0@lo:400:kworker.0 Request processed in 48us (2803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664239.169080:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140468096 00000100:00100000:0.0:1788664239.169085:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140468096 00000100:00100000:0.0:1788664239.169106:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140468608 00000100:00100000:0.0:1788664239.169109:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140468608 00000100:00100000:0.0:1788664239.169122:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140469120 00000100:00100000:0.0:1788664239.169124:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140469120 00000100:00100000:0.0:1788664239.169134:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140468736 00000100:00100000:0.0:1788664239.169137:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140468736 00000100:00100000:0.0:1788664239.169146:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140469248 00000100:00100000:0.0:1788664239.169148:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140469248 00000100:00100000:0.0:1788664239.169157:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140468352 00000100:00100000:0.0:1788664239.169160:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140468352 00000100:00100000:0.0:1788664239.169171:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788664239.169177:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140468096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664239.169212:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140468096:12345-0@lo:400:kworker.0 Request processed in 35us (2927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664239.169218:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788664239.169230:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788664239.169242:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140468608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664239.169269:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140468608:12345-0@lo:400:kworker.0 Request processed in 28us (2955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664239.169275:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788664239.169286:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788664239.169291:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140469120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664239.169316:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140469120:12345-0@lo:400:kworker.0 Request processed in 25us (2961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664239.169321:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788664239.169330:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788664239.169335:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140468736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664239.169359:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140468736:12345-0@lo:400:kworker.0 Request processed in 24us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664239.169364:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788664239.169374:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788664239.169379:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140469248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664239.169405:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140469248:12345-0@lo:400:kworker.0 Request processed in 26us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664239.169411:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788664239.169420:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788664239.169425:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140468352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664239.169449:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140468352:12345-0@lo:400:kworker.0 Request processed in 24us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664239.169454:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788664239.169477:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788664239.169489:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140468864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664239.169520:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140468864:12345-0@lo:400:kworker.0 Request processed in 31us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664239.169526:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788664239.169538:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788664239.169543:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140469376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664239.169568:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140469376:12345-0@lo:400:kworker.0 Request processed in 25us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664239.169573:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788664239.170510:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788664239.172042:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140469632 00000100:00100000:1.0:1788664239.172214:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140469632 00000100:00100000:1.0:1788664239.172281:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788664239.172291:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140469632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664239.172327:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664239.172404:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140469632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (6015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664239.172410:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1788664239.172732:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664239.172739:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788664239.172741:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664239.172743:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664239.172799:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140468096:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.172813:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140468608:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.172823:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140469120:0@lo:400:kworker.0 00010000:00080000:1.0:1788664239.173540:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f783800 x1875550140469632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664239.173726:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140469632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664239.173747:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140467968:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.173759:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140468480:0@lo:400:kworker.0 00010000:00080000:1.0:1788664239.173791:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a09880 x1875550140468992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664239.173810:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140468992:0@lo:400:kworker.0 00010000:00080000:1.0:1788664239.173824:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f780700 x1875550140469504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664239.173908:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140469504:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.173972:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140468352:0@lo:400:kworker.0 00010000:00080000:1.0:1788664239.173983:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a0bb80 x1875550140468864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664239.173991:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140468864:0@lo:400:kworker.0 00010000:00080000:1.0:1788664239.174002:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f783100 x1875550140469376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664239.174009:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140469376:0@lo:400:kworker.0 00000100:00100000:1.0:1788664239.174030:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140468224:0@lo:400:kworker.0 00010000:00080000:1.0:1788664239.174041:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a08e00 x1875550140468736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664239.174106:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140468736:0@lo:400:kworker.0 00010000:00080000:1.0:1788664239.174121:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a09180 x1875550140469248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664239.174129:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140469248:0@lo:400:kworker.0 00010000:00010000:2.0:1788664239.549947:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664239.684435:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664239.684469:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140469760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664239.684541:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664239.684849:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140469760 00000100:00100000:2.0:1788664239.684858:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140469760 00000100:00100000:2.0:1788664239.684910:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788664239.684919:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140469760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788664239.684947:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664239.684999:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140469760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664239.685020:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1788664239.685070:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b45180 x1875550140469760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664239.685090:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140469760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664239.766859:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664239.766891:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664239.766920:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664239.766938:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664239.766964:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664239.766991:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119413760 00000100:00100000:2.0:1788664239.767001:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119413760 00000100:00100000:1.0:1788664239.767046:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119413888 00000100:00100000:1.0:1788664239.767052:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119413888 00000100:00100000:2.0:1788664239.767064:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 315 00000100:00100000:2.0:1788664239.767076:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2393:x1875550119413760:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664239.767108:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119414144 00000100:00100000:1.0:1788664239.767113:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119414144 00000100:00100000:1.0:1788664239.767129:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119414016 00000100:00100000:1.0:1788664239.767132:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119414016 00000100:00100000:1.0:1788664239.767146:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119414272 00000100:00100000:1.0:1788664239.767149:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119414272 00000100:00100000:2.0:1788664239.767158:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2393:x1875550119413760:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664239.767167:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:2.0:1788664239.767171:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 315 00000100:00100000:1.0:1788664239.767180:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2393:x1875550119413888:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664239.767213:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:1.0:1788664239.767222:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2393:x1875550119413888:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 44us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664239.767224:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119414144:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664239.767237:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:2.0:1788664239.767264:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119414144:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 42us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664239.767268:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:2.0:1788664239.767277:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:1.0:1788664239.767282:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119414016:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664239.767298:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 197 00000100:00100000:2.0:1788664239.767308:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119414272:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664239.767316:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119414016:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664239.767324:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:2.0:1788664239.767342:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119414272:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 35us (375us total) trans 0 rc 0/0 00000100:00080000:1.0:1788664239.767345:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664239.767350:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664239.767352:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 197 00000100:00100000:1.0:1788664240.190032:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664240.190057:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140469888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664240.190126:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664240.190184:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140469888 00000100:00100000:2.0:1788664240.190192:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140469888 00000100:00100000:2.0:1788664240.190241:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788664240.190250:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140469888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788664240.190286:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788664240.190343:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140469888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664240.190350:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788664240.190417:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140469888:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1788664240.498948:0:12890:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788664240.499197:0:12890:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788664240.574288:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664240.702027:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140470016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788664240.702271:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664240.702353:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140470016 00000100:00100000:1.0:1788664240.702361:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140470016 00000100:00100000:3.0:1788664240.703544:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140470144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664240.703599:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664240.704592:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140470144 00000100:00100000:1.0:1788664240.704602:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140470144 00000100:00100000:1.0:1788664240.704709:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788664240.704726:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140470016:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664240.704853:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788664240.704863:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140470144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788664240.704888:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664240.704964:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140470144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664240.704977:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1788664240.705429:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3036fb800 x1875550140470144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000001:00100000:3.0:1788664240.707644:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc 00000020:00000080:3.0:1788664240.707653:0:8422:0:(genops.c:885:class_export_put()) final put ffff93c3029ff000/6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc 00000020:00000080:3.0:1788664240.707696:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c3029ff000/6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc for lustre-OST0000 00000020:00000080:3.0:1788664240.707736:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c3029f8000 for lustre-OST0000 00000100:00100000:0.0:1788664240.708232:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140470144:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788664240.712130:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc 00000020:00000080:2.0:1788664240.712141:0:9506:0:(genops.c:885:class_export_put()) final put ffff93c302974800/6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc 00000020:00000080:3.0:1788664240.712201:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c302974800/6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc for lustre-OST0001 00000020:00000080:3.0:1788664240.712256:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c302972000 for lustre-OST0001 00002000:00000024:1.0:1788664240.714569:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664240.714732:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140470016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10004us (12456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664240.714752:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1788664240.715902:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303742a00 x1875550140470016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664240.715928:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140470016:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788664241.598218:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664242.623108:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664243.646594:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664243.777973:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664243.779499:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140470272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664243.779577:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664243.785057:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140470272 00000100:00100000:1.0:1788664243.785076:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140470272 00000100:00100000:1.0:1788664243.785354:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788664243.785365:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140470272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788664243.785405:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788664243.785503:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140470272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (5925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664243.785510:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788664243.785627:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140470272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664244.289396:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140470528:0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.289470:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664244.289538:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140471040:0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.289561:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664244.289585:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140471552:0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.289606:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664244.289633:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788664244.289653:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140470656:0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.289682:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664244.289700:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140471168:0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.289720:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664244.289734:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140471680:0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.289753:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664244.290024:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140470528 00000100:00100000:0.0:1788664244.290032:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140470528 00000100:00100000:0.0:1788664244.290066:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140471040 00000100:00100000:0.0:1788664244.290069:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140471040 00000100:00100000:0.0:1788664244.290089:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140471552 00000100:00100000:0.0:1788664244.290092:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140471552 00000100:00100000:0.0:1788664244.290103:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140471168 00000100:00100000:0.0:1788664244.290105:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140471168 00000100:00100000:0.0:1788664244.290116:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140471680 00000100:00100000:0.0:1788664244.290118:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140471680 00000100:00100000:0.0:1788664244.290132:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788664244.290140:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140470528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.290197:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140470528:12345-0@lo:400:kworker.0 Request processed in 58us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664244.290204:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788664244.290218:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788664244.290223:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140471040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.290248:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140471040:12345-0@lo:400:kworker.0 Request processed in 24us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664244.290254:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788664244.290264:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788664244.290270:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140471552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.290309:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140471552:12345-0@lo:400:kworker.0 Request processed in 39us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664244.290315:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788664244.290328:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788664244.290335:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140471168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.290363:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140471168:12345-0@lo:400:kworker.0 Request processed in 28us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664244.290369:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788664244.290381:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788664244.290388:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140471680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664244.290399:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664244.290415:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140472064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664244.290416:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140471680:12345-0@lo:400:kworker.0 Request processed in 28us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664244.290426:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788664244.290453:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140470784:0@lo:400:kworker.0 00000100:00100000:2.0:1788664244.290462:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664244.290487:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664244.290507:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140472064 00000100:00100000:0.0:1788664244.290511:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140471296:0@lo:400:kworker.0 00000100:00100000:2.0:1788664244.290514:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140472064 00000100:00100000:0.0:1788664244.290541:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664244.290561:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140471808:0@lo:400:kworker.0 00000100:00100000:2.0:1788664244.290569:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788664244.290581:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140472064:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664244.290588:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788664244.290608:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664244.290611:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788664244.290618:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140470400:0@lo:400:kworker.0 00000100:00100000:1.0:1788664244.290706:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140470784 00000100:00100000:1.0:1788664244.290711:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140470784 00000100:00100000:1.0:1788664244.290739:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788664244.290745:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140470784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664244.296607:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140472064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6019us (6135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664244.296623:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1788664244.296711:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b46300 x1875550140472064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664244.296735:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140472064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664244.296824:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140471296 00000100:00100000:2.0:1788664244.296831:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140471296 00000100:00100000:2.0:1788664244.296872:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140471808 00000100:00100000:2.0:1788664244.296875:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140471808 00000100:00100000:2.0:1788664244.296900:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788664244.296908:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140471296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664244.297008:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140471296:12345-0@lo:400:kworker.0 Request processed in 101us (6466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664244.297015:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788664244.297028:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788664244.297035:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140471808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664244.298423:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140471808:12345-0@lo:400:kworker.0 Request processed in 1381us (7827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664244.298436:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1788664244.298476:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664244.298482:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664244.298485:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788664244.298488:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664244.298501:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140470656 00000100:00100000:2.0:1788664244.298507:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140470656 00000100:00100000:2.0:1788664244.298705:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788664244.298714:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140470656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664244.298768:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140470656:12345-0@lo:400:kworker.0 Request processed in 56us (9085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664244.298795:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788664244.298884:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140470656:0@lo:400:kworker.0 00010000:00080000:2.0:1788664244.298900:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abad80 x1875550140471168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664244.298910:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140471168:0@lo:400:kworker.0 00010000:00080000:2.0:1788664244.298932:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abaa00 x1875550140471680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664244.298940:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140471680:0@lo:400:kworker.0 00000100:00100000:2.0:1788664244.298952:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140470528:0@lo:400:kworker.0 00000100:00100000:2.0:1788664244.298962:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140471040:0@lo:400:kworker.0 00000100:00100000:2.0:1788664244.298971:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140471552:0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.302125:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664244.302202:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140470912:0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.302258:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664244.302291:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303aba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140471424:0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.302316:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664244.302334:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140471936:0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.302353:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788664244.302471:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303ab9c00 x1875550140471296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664244.302485:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140471296:0@lo:400:kworker.0 00010000:00080000:0.0:1788664244.302496:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303aba680 x1875550140471808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664244.302504:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140471808:0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.302612:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140471424 00000100:00100000:0.0:1788664244.302619:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140471424 00000100:00100000:0.0:1788664244.302669:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140471936 00000100:00100000:0.0:1788664244.302672:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140471936 00000100:00100000:0.0:1788664244.302690:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788664244.302698:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140471424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.302749:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140471424:12345-0@lo:400:kworker.0 Request processed in 51us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664244.302756:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788664244.303452:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788664244.303467:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140471936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.303513:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140471936:12345-0@lo:400:kworker.0 Request processed in 52us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664244.303592:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788664244.303629:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140470912 00000100:00100000:0.0:1788664244.303643:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140470912 00000100:00100000:0.0:1788664244.303676:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788664244.303682:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140470912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.303720:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140470912:12345-0@lo:400:kworker.0 Request processed in 38us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664244.303726:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1788664244.303741:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664244.303899:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140470784:12345-0@lo:400:kworker.0 Request processed in 13152us (13412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664244.304016:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788664244.304155:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140470912:0@lo:400:kworker.0 00010000:00080000:0.0:1788664244.304174:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303aba300 x1875550140471424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664244.304184:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303aba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140471424:0@lo:400:kworker.0 00010000:00080000:0.0:1788664244.304194:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303ab8e00 x1875550140471936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664244.304201:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140471936:0@lo:400:kworker.0 00000100:00100000:0.0:1788664244.304212:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140470784:0@lo:400:kworker.0 00000100:00100000:2.0:1788664244.305303:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140470400 00000100:00100000:2.0:1788664244.305314:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140470400 00000100:00100000:2.0:1788664244.305369:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788664244.305378:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140470400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664244.305450:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140470400:12345-0@lo:400:kworker.0 Request processed in 73us (3331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664244.305458:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788664244.305506:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140470400:0@lo:400:kworker.0 00010000:00010000:2.0:1788664244.672079:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664244.800367:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664244.800389:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140472192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664244.800465:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664244.801163:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140472192 00000100:00100000:1.0:1788664244.801173:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140472192 00000100:00100000:1.0:1788664244.801240:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788664244.801249:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140472192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788664244.801277:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664244.801352:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140472192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664244.801360:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1788664244.802123:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42e979c00 x1875550140472192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664244.802145:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140472192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664244.895648:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664244.895695:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664244.895730:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664244.895818:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664244.895887:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664244.896196:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119414400 00000100:00100000:2.0:1788664244.896206:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119414400 00000100:00100000:2.0:1788664244.896271:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 317 00000100:00100000:2.0:1788664244.896283:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2391:x1875550119414400:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664244.896356:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2391:x1875550119414400:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 75us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664244.896363:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 317 00000100:00100000:2.0:1788664244.896400:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119414656 00000100:00100000:2.0:1788664244.896403:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119414656 00000100:00100000:2.0:1788664244.896456:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119414912 00000100:00100000:2.0:1788664244.896460:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119414912 00000100:00100000:2.0:1788664244.896475:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119414528 00000100:00100000:2.0:1788664244.896477:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119414528 00000100:00100000:2.0:1788664244.896490:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119414784 00000100:00100000:2.0:1788664244.896492:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119414784 00000100:00100000:2.0:1788664244.896508:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:2.0:1788664244.896515:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119414656:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664244.896549:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119414656:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 34us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664244.896569:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:2.0:1788664244.896582:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:2.0:1788664244.896588:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119414912:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664244.896615:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119414912:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664244.896621:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:2.0:1788664244.896634:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:2.0:1788664244.896641:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119414528:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664244.896668:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119414528:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664244.896673:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:2.0:1788664244.896684:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:2.0:1788664244.896690:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119414784:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664244.896713:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119414784:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664244.896719:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00080000:2.0:1788664244.896923:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664244.896928:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1788664245.108507:0:13034:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788664245.312472:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140472320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788664245.312541:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664245.312616:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140472320 00000100:00100000:3.0:1788664245.312623:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140472320 00000100:00100000:3.0:1788664245.313480:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788664245.313493:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140472320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788664245.313530:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788664245.313592:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140472320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664245.313599:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788664245.314542:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140472320:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788664245.694086:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664245.822726:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664245.822751:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140472448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664245.822845:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664245.823148:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140472448 00000100:00100000:3.0:1788664245.823169:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140472448 00000100:00100000:3.0:1788664245.823237:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788664245.823246:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140472448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788664245.823274:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664245.823343:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140472448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664245.823350:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:0.0:1788664245.823766:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3036f9500 x1875550140472448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664245.823810:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140472448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664245.824001:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140472576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664245.824041:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664245.824204:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140472576 00000100:00100000:1.0:1788664245.824210:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140472576 00000100:00100000:1.0:1788664245.824250:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788664245.824257:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140472576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788664245.824271:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664245.824313:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140472576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664245.824319:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1788664245.824425:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303743100 x1875550140472576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664245.824439:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140472576:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788664246.723647:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664247.742020:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664248.768174:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664248.894811:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140472704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664248.894887:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664248.895064:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140472704 00000100:00100000:0.0:1788664248.895082:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140472704 00000100:00100000:0.0:1788664248.895128:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788664248.895137:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140472704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788664248.895171:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788664248.895220:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140472704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664248.895228:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788664248.895336:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140472704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664249.406467:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664249.406494:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140472832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664249.406572:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664249.407071:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140472832 00000100:00100000:2.0:1788664249.407088:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140472832 00000100:00100000:2.0:1788664249.407155:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788664249.407166:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140472832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664249.407203:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664249.407512:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140473344:0@lo:400:kworker.0 00000100:00100000:0.0:1788664249.407559:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664249.407601:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140473856:0@lo:400:kworker.0 00000100:00100000:0.0:1788664249.407626:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664249.407659:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788664249.407664:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140472960:0@lo:400:kworker.0 00000100:00100000:0.0:1788664249.407692:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664249.407712:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140473472:0@lo:400:kworker.0 00000100:00100000:0.0:1788664249.407733:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664249.407750:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140473984:0@lo:400:kworker.0 00000100:00100000:0.0:1788664249.407789:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664249.407818:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140473856 00000100:00100000:0.0:1788664249.407822:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140473856 00000100:00100000:0.0:1788664249.407855:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788664249.407863:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140473856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664249.407907:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140473856:12345-0@lo:400:kworker.0 Request processed in 44us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664249.407914:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788664249.407935:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140472960 00000100:00100000:0.0:1788664249.407938:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140472960 00000100:00100000:0.0:1788664249.407974:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788664249.407989:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140472960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664249.408018:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140472960:12345-0@lo:400:kworker.0 Request processed in 39us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664249.408024:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788664249.408052:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140473344 00000100:00100000:0.0:1788664249.408055:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140473344 00000100:00100000:0.0:1788664249.408076:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140473472 00000100:00100000:0.0:1788664249.408079:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140473472 00000100:00100000:0.0:1788664249.408106:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140473984 00000100:00100000:0.0:1788664249.408109:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140473984 00000100:00100000:0.0:1788664249.408122:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788664249.408128:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140473344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664249.408161:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140473344:12345-0@lo:400:kworker.0 Request processed in 34us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664249.408167:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788664249.408177:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788664249.408183:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140473472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664249.408221:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140473472:12345-0@lo:400:kworker.0 Request processed in 38us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664249.408227:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788664249.408242:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788664249.408248:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140473984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664249.408280:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140473984:12345-0@lo:400:kworker.0 Request processed in 33us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664249.408285:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788664249.408320:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140472960:0@lo:400:kworker.0 00000100:00100000:0.0:1788664249.408335:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140473472:0@lo:400:kworker.0 00000100:00100000:0.0:1788664249.408344:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140473984:0@lo:400:kworker.0 00000100:00100000:0.0:1788664249.408356:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140473344:0@lo:400:kworker.0 00010000:00080000:0.0:1788664249.408370:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f762a00 x1875550140473856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664249.408381:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140473856:0@lo:400:kworker.0 00000100:00100000:2.0:1788664249.409062:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140472832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1897us (2488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664249.409072:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788664249.409108:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140473216:0@lo:400:kworker.0 00000100:00100000:2.0:1788664249.409151:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664249.409182:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140473728:0@lo:400:kworker.0 00000100:00100000:2.0:1788664249.409207:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664249.409432:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140474240:0@lo:400:kworker.0 00000100:00100000:2.0:1788664249.409587:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664249.409619:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788664249.409629:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140473088:0@lo:400:kworker.0 00000100:00080000:3.0:1788664249.409791:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664249.409797:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664249.409799:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788664249.410131:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303743100 x1875550140472832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664249.410155:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140472832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664249.410902:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140473216 00000100:00100000:0.0:1788664249.410910:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140473216 00000100:00100000:2.0:1788664249.411025:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664249.411061:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140473600:0@lo:400:kworker.0 00000100:00100000:1.0:1788664249.411078:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140473088 00000100:00100000:1.0:1788664249.411084:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140473088 00000100:00100000:2.0:1788664249.411090:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664249.411113:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140474112:0@lo:400:kworker.0 00000100:00100000:1.0:1788664249.411120:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140473600 00000100:00100000:1.0:1788664249.411125:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140473600 00000100:00100000:2.0:1788664249.411140:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664249.411153:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140474112 00000100:00100000:1.0:1788664249.411156:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140474112 00000100:00100000:2.0:1788664249.411180:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788664249.411191:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140473088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664249.411248:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140473088:12345-0@lo:400:kworker.0 Request processed in 59us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664249.411720:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788664249.411735:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140473216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664249.411806:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788664249.411818:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140473600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664249.411826:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140473216:12345-0@lo:400:kworker.0 Request processed in 94us (2671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664249.411834:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788664249.411865:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140473600:12345-0@lo:400:kworker.0 Request processed in 50us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664249.411870:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788664249.411879:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788664249.411884:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140474112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664249.411920:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140474112:12345-0@lo:400:kworker.0 Request processed in 41us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664249.411926:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788664249.412095:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788664249.412136:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140473728 00000100:00100000:2.0:1788664249.412140:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140473728 00000100:00100000:2.0:1788664249.412168:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140474240 00000100:00100000:2.0:1788664249.412171:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140474240 00000100:00100000:2.0:1788664249.412204:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788664249.412212:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140473728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664249.412246:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140473728:12345-0@lo:400:kworker.0 Request processed in 35us (3038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664249.412253:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788664249.412264:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788664249.412269:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303aba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140474240:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788664249.412283:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788664249.412289:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664249.412293:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664249.412303:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303aba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140474240:12345-0@lo:400:kworker.0 Request processed in 33us (2715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664249.412308:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788664249.413454:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140473088:0@lo:400:kworker.0 00010000:00080000:2.0:1788664249.413714:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f762680 x1875550140473600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664249.413728:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140473600:0@lo:400:kworker.0 00010000:00080000:2.0:1788664249.413746:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f7480 x1875550140474112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664249.413755:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140474112:0@lo:400:kworker.0 00000100:00100000:2.0:1788664249.413801:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140473216:0@lo:400:kworker.0 00010000:00080000:2.0:1788664249.413816:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f763480 x1875550140473728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664249.413826:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140473728:0@lo:400:kworker.0 00010000:00080000:2.0:1788664249.413849:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f4380 x1875550140474240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664249.413857:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140474240:0@lo:400:kworker.0 00000020:00000080:2.0:1788664249.448757:0:13183:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8aaf4380 20000000:00000080:2.0:1788664249.448795:0:13183:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c3038bd800 uarg=0000000000000000 20000000:01000000:2.0:1788664249.448837:0:13183:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788664249.448843:0:13183:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788664249.448847:0:13183:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788664249.449722:0:13184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788664249.450125:0:13183:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788664249.460334:0:13183:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788664249.460392:0:13183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c303b85600/0xcd11f61c1413d84b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664249.460414:0:13183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4029e3c00/0xcd11f61c1413d75d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1a4 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664249.460441:0:13183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c400030800/0xcd11f61c1413d787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d780 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664249.460448:0:13183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c400030a00/0xcd11f61c1413d7b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d7aa expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664249.460456:0:13183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4351eec00/0xcd11f61c1413d7db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d7d4 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664249.460463:0:13183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413d805 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d7fe expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664249.460471:0:13183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1e3 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664249.460479:0:13183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c303b85600/0xcd11f61c1413d84b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664249.460520:0:13183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1e3 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664249.460536:0:13183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d828 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1e3 expref: 12 pid: 6506 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664249.460551:0:13183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303740700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13183:1875550140474368:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664249.460655:0:13183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413d805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d7fe expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664249.460664:0:13183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413d805 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d7fe expref: 23 pid: 6506 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664249.460680:0:13183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303742a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13183:1875550140474496:0@lo:104: 00000100:00100000:1.0:1788664249.460719:0:13183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664249.460762:0:13183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4351eec00/0xcd11f61c1413d7db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d7d4 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664249.460808:0:13183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c4351eec00/0xcd11f61c1413d7db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d7d4 expref: 23 pid: 6505 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664249.460817:0:13183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13183:1875550140474624:0@lo:104: 00000100:00100000:1.0:1788664249.460839:0:13183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664249.460867:0:13183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c400030a00/0xcd11f61c1413d7b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d7aa expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664249.460874:0:13183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c400030a00/0xcd11f61c1413d7b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d7aa expref: 23 pid: 6505 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664249.460881:0:13183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f780700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13183:1875550140474752:0@lo:104: 00000100:00100000:1.0:1788664249.460900:0:13183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664249.460915:0:13183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c400030800/0xcd11f61c1413d787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d780 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664249.460923:0:13183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c400030800/0xcd11f61c1413d787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d780 expref: 23 pid: 6505 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664249.460931:0:13183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a09180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13183:1875550140474880:0@lo:104: 00000100:00100000:1.0:1788664249.460960:0:13183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664249.460977:0:13183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4029e3c00/0xcd11f61c1413d75d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1a4 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664249.460995:0:13183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c4029e3c00/0xcd11f61c1413d75d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1a4 expref: 12 pid: 6504 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664249.461005:0:13183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13183:1875550140475008:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664249.461027:0:13183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c30397ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664249.461355:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140474496 00000100:00100000:2.0:1788664249.461363:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140474496 00000100:00100000:2.0:1788664249.461398:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140474624 00000100:00100000:2.0:1788664249.461400:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140474624 00000100:00100000:2.0:1788664249.461409:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140474752 00000100:00100000:2.0:1788664249.461411:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140474752 00000100:00100000:2.0:1788664249.461420:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140474880 00000100:00100000:2.0:1788664249.461422:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140474880 00000100:00100000:2.0:1788664249.461434:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788664249.461443:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+6:13183:x1875550140474496:12345-0@lo:104: 00010000:00010000:2.0:1788664249.461454:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d7fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d805 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.461508:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664249.461515:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+6:13183:x1875550140474496:12345-0@lo:104: Request processed in 73us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664249.461522:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788664249.461540:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788664249.461546:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+5:13183:x1875550140474624:12345-0@lo:104: 00010000:00010000:2.0:1788664249.461561:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4351efe00/0xcd11f61c1413d7d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d7db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.461594:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788664249.461599:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+5:13183:x1875550140474624:12345-0@lo:104: Request processed in 54us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664249.461605:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788664249.461629:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788664249.461635:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:13183:x1875550140474752:12345-0@lo:104: 00010000:00010000:2.0:1788664249.461642:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d7aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d7b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.461673:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788664249.461678:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:13183:x1875550140474752:12345-0@lo:104: Request processed in 45us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664249.461684:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788664249.461694:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788664249.461700:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:13183:x1875550140474880:12345-0@lo:104: 00010000:00010000:2.0:1788664249.461706:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413d780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d787 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.461729:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788664249.461734:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:13183:x1875550140474880:12345-0@lo:104: Request processed in 35us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664249.461739:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788664249.461753:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788664249.461759:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d7fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d805 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.461807:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664249.461812:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d7fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d805 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.461820:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d7fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d805 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664249.461827:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d7fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d805 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664249.461833:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788664249.461862:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d7fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d805 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.461868:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664249.461886:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d7fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d805 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.461894:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413d7fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d805 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.461908:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788664249.461911:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4351efe00/0xcd11f61c1413d7d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d7db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.461917:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351efe00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664249.461919:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4351efe00/0xcd11f61c1413d7d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d7db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.461936:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4351efe00/0xcd11f61c1413d7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d7db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664249.461952:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4351efe00/0xcd11f61c1413d7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d7db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664249.461957:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788664249.461972:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4351efe00/0xcd11f61c1413d7d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d7db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.461978:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664249.461984:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4351efe00/0xcd11f61c1413d7d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d7db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.461990:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4351efe00/0xcd11f61c1413d7d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d7db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.461999:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788664249.462002:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d7aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d7b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462008:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664249.462011:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d7aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d7b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462017:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d7aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d7b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664249.462023:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d7aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d7b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664249.462033:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788664249.462047:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d7aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d7b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462052:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664249.462067:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d7aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d7b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462074:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c400030400/0xcd11f61c1413d7aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d7b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462084:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664249.462087:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413d780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d787 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462093:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2a00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664249.462096:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413d780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d787 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462103:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413d780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d787 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664249.462110:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413d780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d787 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664249.462115:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788664249.462124:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413d780 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d787 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462129:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664249.462141:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413d780 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d787 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462147:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413d780 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d787 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462160:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664249.462162:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664249.462163:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664249.462170:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664249.462175:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664249.462193:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140475136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664249.462237:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664249.462267:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664249.462273:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140475264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664249.462293:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664249.462324:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140475392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664249.462346:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664249.462362:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664249.462367:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140475520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664249.462384:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664249.462409:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140475136 00000100:00100000:2.0:1788664249.462414:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140475136 00010000:00010000:2.0:1788664249.462431:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413d805 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d7fe expref: 24 pid: 6506 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664249.462450:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140475264 00000100:00100000:2.0:1788664249.462453:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140475264 00010000:00010000:2.0:1788664249.462464:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4351eec00/0xcd11f61c1413d7db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d7d4 expref: 25 pid: 6505 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664249.462484:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140475392 00000100:00100000:2.0:1788664249.462487:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140475392 00010000:00010000:2.0:1788664249.462497:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c400030a00/0xcd11f61c1413d7b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d7aa expref: 26 pid: 6505 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664249.462506:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140475520 00000100:00100000:2.0:1788664249.462509:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140475520 00010000:00010000:2.0:1788664249.462517:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c400030800/0xcd11f61c1413d787 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d780 expref: 27 pid: 6505 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664249.462529:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788664249.462535:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+27:3638:x1875550140475136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664249.462545:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664249.462549:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413d805 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d7fe expref: 27 pid: 6506 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462557:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413d805 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d7fe expref: 27 pid: 6506 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462572:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664249.462599:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+27:3638:x1875550140475136:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664249.462606:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788664249.462620:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788664249.462625:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+26:3638:x1875550140475264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664249.462632:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664249.462636:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4351eec00/0xcd11f61c1413d7db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d7d4 expref: 26 pid: 6505 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462651:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4351eec00/0xcd11f61c1413d7db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d7d4 expref: 26 pid: 6505 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462661:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664249.462684:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+26:3638:x1875550140475264:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664249.462690:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788664249.462702:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788664249.462707:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+25:3636:x1875550140475392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664249.462715:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664249.462719:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c400030a00/0xcd11f61c1413d7b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d7aa expref: 25 pid: 6505 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462727:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c400030a00/0xcd11f61c1413d7b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d7aa expref: 25 pid: 6505 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462735:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664249.462757:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+25:3636:x1875550140475392:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664249.462763:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788664249.462801:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788664249.462807:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140475520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664249.462816:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664249.462821:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c400030800/0xcd11f61c1413d787 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d780 expref: 24 pid: 6505 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462829:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c400030800/0xcd11f61c1413d787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d780 expref: 24 pid: 6505 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.462844:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664249.462866:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140475520:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664249.462871:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788664249.462914:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140475520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664249.462922:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140475392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664249.462959:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140475264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664249.462966:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140475136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788664249.464450:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413d805 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d7fe expref: 23 pid: 6506 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664249.464470:0:13183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303742a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13183:1875550140474496:0@lo:104: 00010000:00010000:1.0:1788664249.464483:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4351eec00/0xcd11f61c1413d7db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d7d4 expref: 22 pid: 6505 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664249.464491:0:13183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13183:1875550140474624:0@lo:104: 00010000:00010000:1.0:1788664249.464499:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c400030a00/0xcd11f61c1413d7b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d7aa expref: 21 pid: 6505 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664249.464507:0:13183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f780700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13183:1875550140474752:0@lo:104: 00010000:00010000:1.0:1788664249.464516:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c400030800/0xcd11f61c1413d787 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d780 expref: 20 pid: 6505 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664249.464523:0:13183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a09180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13183:1875550140474880:0@lo:104: 00000100:00100000:1.0:1788664249.471132:0:13183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303740700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13183:1875550140474368:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664249.471147:0:13183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13183:1875550140475008:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664249.471194:0:13183:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c303b85600/0xcd11f61c1413d84b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664249.472142:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664249.473022:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119415040 00000100:00100000:0.0:1788664249.473034:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119415040 00010000:00010000:0.0:1788664249.473075:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d828 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1e3 expref: 13 pid: 6506 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664249.473150:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:0.0:1788664249.473160:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119415040:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664249.473175:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664249.473181:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d828 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1e3 expref: 13 pid: 6506 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664249.473194:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1e3 expref: 13 pid: 6506 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664249.473212:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4351ee200/0xcd11f61c1413d828 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1e3 expref: 13 pid: 6506 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664249.473241:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664249.473305:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:2390:x1875550119415040:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 146us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664249.473313:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:0.0:1788664249.474472:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664249.474549:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119415168 00000100:00100000:2.0:1788664249.474557:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119415168 00010000:00010000:2.0:1788664249.474586:0:10332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4029e3c00/0xcd11f61c1413d75d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1a4 expref: 12 pid: 6504 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664249.474623:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:2.0:1788664249.474633:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c412c71450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:2390:x1875550119415168:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664249.474644:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664249.474649:0:10332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4029e3c00/0xcd11f61c1413d75d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1a4 expref: 12 pid: 6504 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.474671:0:10332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4029e3c00/0xcd11f61c1413d75d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1a4 expref: 12 pid: 6504 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.474685:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e3c00/0xcd11f61c1413d75d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1a4 expref: 12 pid: 6504 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.474716:0:10332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c303b85600/0xcd11f61c1413d84b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.474725:0:10332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303b85600/0xcd11f61c1413d84b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.474741:0:10332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c303b85600/0xcd11f61c1413d84b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.474747:0:10332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c303b85600/0xcd11f61c1413d84b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.474754:0:10332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c303b85600/0xcd11f61c1413d84b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.474760:0:10332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c303b85600/0xcd11f61c1413d84b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.474767:0:10332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85600 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:2.0:1788664249.474804:0:10332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c303b85600/0xcd11f61c1413d84b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.474814:0:10332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c303b85600/0xcd11f61c1413d84b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.474829:0:10332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c303b85600/0xcd11f61c1413d84b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.474840:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664249.474883:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c412c71450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:2390:x1875550119415168:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 251us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664249.474898:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00010000:00010000:3.0:1788664249.475410:0:13183:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c303b85600/0xcd11f61c1413d84b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664249.475421:0:13183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c303b85600/0xcd11f61c1413d84b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664249.475428:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303b85600/0xcd11f61c1413d84b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664249.790002:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664249.918034:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664249.918060:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140475648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788664249.918127:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664249.918388:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140475648 00000100:00100000:0.0:1788664249.918396:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140475648 00000100:00100000:0.0:1788664249.918448:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788664249.918458:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140475648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664249.918491:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664249.918544:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140475648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664249.918552:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1788664249.919499:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f4e00 x1875550140475648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664249.919521:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140475648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664250.015509:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664250.015551:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664250.015584:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664250.015617:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664250.015648:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119415424 00000100:00100000:1.0:1788664250.015657:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119415424 00000100:00100000:1.0:1788664250.015714:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119415680 00000100:00100000:1.0:1788664250.015718:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119415680 00000100:00100000:1.0:1788664250.015732:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119415296 00000100:00100000:1.0:1788664250.015735:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119415296 00000100:00100000:1.0:1788664250.015746:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119415552 00000100:00100000:1.0:1788664250.015748:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119415552 00000100:00100000:1.0:1788664250.015763:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:1.0:1788664250.015808:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119415424:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664250.015888:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119415424:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 116us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664250.015895:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:1.0:1788664250.015913:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:1.0:1788664250.015919:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2392:x1875550119415680:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664250.015954:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2392:x1875550119415680:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 34us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664250.015960:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:1.0:1788664250.015972:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 216 00000100:00100000:1.0:1788664250.015977:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119415296:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664250.015999:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119415296:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 22us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664250.016028:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 216 00000100:00100000:1.0:1788664250.016041:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00100000:1.0:1788664250.016047:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2392:x1875550119415552:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664250.016071:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2392:x1875550119415552:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664250.016077:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00080000:1.0:1788664250.016094:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788664250.016098:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788664250.430263:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664250.430287:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140475776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664250.430355:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664250.430421:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140475776 00000100:00100000:1.0:1788664250.430429:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140475776 00000100:00100000:1.0:1788664250.430481:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788664250.430490:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140475776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664250.430523:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788664250.430576:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140475776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664250.430583:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788664250.430691:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140475776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664250.589580:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664250.589675:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119415808 00000100:00100000:0.0:1788664250.589686:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119415808 00000100:00100000:0.0:1788664250.589750:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 319 00000100:00100000:0.0:1788664250.589760:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:6163:x1875550119415808:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664250.589812:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664250.589832:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303957000/0xcd11f61c1413d852 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d214 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664250.589860:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303957000/0xcd11f61c1413d852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d214 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664250.589882:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303957000/0xcd11f61c1413d852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d214 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664250.589908:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957000, rc 0) 00000100:00100000:0.0:1788664250.589977:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:6163:x1875550119415808:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 218us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664250.589985:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 319 00000100:00100000:0.0:1788664250.593530:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664250.599656:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119415936 00000100:00100000:2.0:1788664250.599676:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119415936 00000100:00100000:2.0:1788664250.599858:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 320 00000100:00100000:2.0:1788664250.599870:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:6163:x1875550119415936:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664250.600059:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:6163:x1875550119415936:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 190us (6781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664250.600067:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 320 00000100:00100000:1.0:1788664250.610018:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664250.610309:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119416064 00000100:00100000:2.0:1788664250.610329:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119416064 00000100:00100000:2.0:1788664250.610390:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 321 00000100:00100000:2.0:1788664250.610401:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:6163:x1875550119416064:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664250.610756:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:6163:x1875550119416064:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 356us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664250.610764:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 321 00000100:00100000:1.0:1788664250.629051:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664250.630011:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119416192 00000100:00100000:2.0:1788664250.630023:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119416192 00000100:00100000:2.0:1788664250.630091:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 322 00000100:00100000:2.0:1788664250.630102:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:6163:x1875550119416192:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664250.630118:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664250.630136:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d859 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d21b expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664250.630185:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d21b expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664250.630210:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d21b expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664250.630219:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d000, rc 0) 00000100:00100000:2.0:1788664250.630341:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:6163:x1875550119416192:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 240us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664250.630348:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 322 00000100:00100000:0.0:1788664250.643869:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664250.645991:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119416320 00000100:00100000:3.0:1788664250.646009:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119416320 00000100:00100000:3.0:1788664250.646082:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 323 00000100:00100000:3.0:1788664250.646093:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:6163:x1875550119416320:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664250.646282:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:6163:x1875550119416320:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 183us (2415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664250.646290:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 323 00000100:00100000:1.0:1788664250.656213:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664250.656416:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119416448 00000100:00100000:0.0:1788664250.656426:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119416448 00000100:00100000:0.0:1788664250.656483:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 324 00000100:00100000:0.0:1788664250.656492:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:6163:x1875550119416448:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664250.656658:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:6163:x1875550119416448:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 166us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664250.656666:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 324 00010000:00010000:2.0:1788664250.814267:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664250.942348:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140475904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664250.942419:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664250.942978:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140475904 00000100:00100000:0.0:1788664250.942987:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140475904 00000100:00100000:0.0:1788664250.943031:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788664250.943040:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140475904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664250.943072:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664250.943123:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140475904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664250.943131:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:3.0:1788664250.943378:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42e888700 x1875550140475904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664250.943397:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140475904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664250.943413:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664250.943420:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140476032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664250.943445:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664250.943580:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140476032 00000100:00100000:1.0:1788664250.943588:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140476032 00000100:00100000:1.0:1788664250.943614:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788664250.943627:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140476032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788664250.943639:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664250.943670:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140476032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664250.943675:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1788664250.943740:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a08380 x1875550140476032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664250.943765:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140476032:0@lo:13:osp-pre-0-1.0 10000000:01000000:3.0:1788664251.075487:0:6508:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:3.0:1788664251.075506:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c302578800 from 7 10000000:01000000:3.0:1788664251.075511:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788664251.075558:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d860 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664251.075570:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d860 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664251.075582:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d860 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664251.075608:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140476160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664251.075673:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664251.080966:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c40385e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664251.083900:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140476160 00000100:00100000:2.0:1788664251.083915:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140476160 00000100:00100000:2.0:1788664251.083985:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788664251.083995:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140476160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664251.084012:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664251.084031:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0da00/0xcd11f61c1413d867 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d860 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664251.084062:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0da00/0xcd11f61c1413d867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d860 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664251.084074:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0da00/0xcd11f61c1413d867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d860 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664251.084083:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0da00, rc 0) 00000100:00100000:2.0:1788664251.084165:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140476160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (8491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664251.084179:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788664251.084284:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140476160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664251.084314:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d860 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d867 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664251.084324:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d860 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d867 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664251.084398:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140476288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664251.084431:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664251.084470:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c40385e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664251.084540:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140476288 00000100:00100000:0.0:1788664251.084545:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140476288 00000100:00100000:0.0:1788664251.084578:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788664251.084585:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140476288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664251.084724:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140476288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664251.084732:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788664251.084817:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140476288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664251.084849:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140476416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664251.084888:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664251.084916:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c40385e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664251.084966:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140476416 00000100:00100000:0.0:1788664251.084971:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140476416 00000100:00100000:0.0:1788664251.085000:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788664251.085008:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140476416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664251.085764:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140476416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 754us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664251.085839:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788664251.090941:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140476416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788664251.092130:0:13207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788664251.093496:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788664251.093539:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788664251.093549:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d860 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d867 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664251.093563:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d860 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d867 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664251.093572:0:6508:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788664251.093575:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c42f78b000 from 7 10000000:01000000:1.0:1788664251.093578:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664251.093614:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413d86e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664251.093622:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413d86e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664251.093633:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413d86e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664251.093658:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140476544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788664251.093723:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664251.093767:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42da4e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664251.093842:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140476544 00000100:00100000:2.0:1788664251.093849:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140476544 00000100:00100000:2.0:1788664251.093908:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788664251.093917:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140476544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664251.093941:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664251.093954:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d875 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d86e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664251.093979:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d86e expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664251.093988:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d86e expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664251.093996:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d400, rc 0) 00000100:00100000:2.0:1788664251.094036:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140476544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664251.094043:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788664251.094124:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140476544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664251.094146:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413d86e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d875 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664251.094154:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413d86e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d875 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664251.094208:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140476672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664251.094235:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664251.094257:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42da4e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664251.094298:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140476672 00000100:00100000:2.0:1788664251.094303:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140476672 00000100:00100000:2.0:1788664251.094344:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788664251.094351:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140476672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664251.094451:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140476672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664251.094458:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788664251.094672:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140476672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664251.094700:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140476800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664251.094737:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664251.094879:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42da4e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664251.094915:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140476800 00000100:00100000:2.0:1788664251.094920:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140476800 00000100:00100000:2.0:1788664251.094961:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788664251.094969:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140476800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664251.095049:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140476800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664251.095056:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788664251.095141:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140476800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788664251.098096:0:13208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788664251.098750:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788664251.098807:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788664251.098818:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413d86e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d875 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664251.098832:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413d86e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d875 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664251.098843:0:6508:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1788664251.098845:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c42d99f800 from 7 10000000:01000000:0.0:1788664251.098848:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788664251.098882:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303957e00/0xcd11f61c1413d87c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664251.098890:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303957e00/0xcd11f61c1413d87c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664251.098900:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303957e00/0xcd11f61c1413d87c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664251.100614:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140476928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788664251.100756:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664251.100817:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3038a1000 going to sleep for 11 seconds 00000100:00100000:0.0:1788664251.101000:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140476928 00000100:00100000:0.0:1788664251.101008:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140476928 00000100:00100000:0.0:1788664251.101058:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788664251.101066:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140476928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664251.101083:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664251.101099:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303956c00/0xcd11f61c1413d883 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d87c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664251.101126:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303956c00/0xcd11f61c1413d883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d87c expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664251.101146:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303956c00/0xcd11f61c1413d883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d87c expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664251.101155:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956c00, rc 0) 00000100:00100000:0.0:1788664251.101204:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140476928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664251.101211:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788664251.103479:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140476928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664251.103518:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303957e00/0xcd11f61c1413d87c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d883 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664251.103530:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303957e00/0xcd11f61c1413d87c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d883 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664251.103612:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140477056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664251.103666:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664251.103700:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4126d16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664251.103712:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140477056 00000100:00100000:1.0:1788664251.103718:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140477056 00000100:00100000:1.0:1788664251.103885:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788664251.103894:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140477056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664251.104026:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140477056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664251.104034:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788664251.104146:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140477056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664251.104174:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140477184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664251.104211:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664251.104230:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4126d16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664251.105450:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140477184 00000100:00100000:0.0:1788664251.105459:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140477184 00000100:00100000:0.0:1788664251.105497:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788664251.105511:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140477184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664251.105638:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140477184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664251.105646:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788664251.105816:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140477184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788664251.110128:0:13210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788664251.110235:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788664251.110253:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788664251.110264:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303957e00/0xcd11f61c1413d87c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d883 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664251.110294:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303957e00/0xcd11f61c1413d87c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d883 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664251.110304:0:6508:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:3.0:1788664251.110307:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c40641a800 from 7 10000000:01000000:3.0:1788664251.110309:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788664251.110343:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d88a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664251.110351:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d88a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664251.110361:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d88a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664251.110385:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140477312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664251.110442:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664251.110471:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4126d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788664251.111057:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140477312 00000100:00100000:0.0:1788664251.111065:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140477312 00000100:00100000:0.0:1788664251.111107:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788664251.111115:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140477312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664251.111129:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664251.111141:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303957600/0xcd11f61c1413d891 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d88a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664251.111163:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303957600/0xcd11f61c1413d891 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d88a expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664251.111173:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303957600/0xcd11f61c1413d891 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d88a expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664251.111181:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957600, rc 0) 00000100:00100000:0.0:1788664251.111228:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140477312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664251.111235:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788664251.111342:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140477312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664251.111357:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d88a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d891 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664251.111365:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d88a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d891 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664251.111419:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140477440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664251.111446:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664251.111478:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4126d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788664251.111725:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140477440 00000100:00100000:0.0:1788664251.111730:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140477440 00000100:00100000:0.0:1788664251.111766:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788664251.111791:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140477440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664251.111898:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140477440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664251.111903:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140477440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664251.111905:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788664251.111928:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140477568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664251.111978:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664251.112000:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4126d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788664251.112010:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140477568 00000100:00100000:0.0:1788664251.112013:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140477568 00000100:00100000:0.0:1788664251.112036:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788664251.112042:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140477568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664251.112127:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140477568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664251.112134:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140477568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664251.112134:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000040:00080000:0.0:1788664251.112818:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788664251.112864:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788664251.112920:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788664251.112928:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d88a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d891 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664251.112950:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d88a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d891 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664251.845667:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664252.864565:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664253.888510:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664254.019488:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664254.019511:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140477696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664254.019587:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664254.019646:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140477696 00000100:00100000:1.0:1788664254.019653:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140477696 00000100:00100000:1.0:1788664254.019694:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788664254.019702:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140477696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788664254.019734:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788664254.019803:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140477696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664254.019811:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788664254.019850:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140477696:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788664254.177706:0:13382:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788664254.541256:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140478208:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.541352:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664254.541429:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140478720:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.541459:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664254.541479:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140479232:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.541505:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664254.541535:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788664254.541541:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140477824:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.541574:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664254.541608:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140478336:0@lo:400:kworker.0 00000100:00100000:3.0:1788664254.541626:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140477824 00000100:00100000:2.0:1788664254.541633:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664254.541637:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140477824 00000100:00100000:2.0:1788664254.541650:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140478848:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.541670:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664254.541697:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140477952:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.541724:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664254.541754:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140478464:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.541808:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664254.541826:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140478976:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.541847:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664254.541859:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788664254.541865:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140478080:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.541889:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664254.541921:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140478592:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.541945:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664254.541965:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140479104:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.541986:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664254.542007:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788664254.542016:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140478720 00000100:00100000:3.0:1788664254.542019:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140477824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.542020:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140478720 00000100:00100000:2.0:1788664254.542051:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140479232 00000100:00100000:2.0:1788664254.542054:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140479232 00000100:00100000:2.0:1788664254.542066:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140478592 00000100:00100000:2.0:1788664254.542068:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140478592 00000100:00100000:2.0:1788664254.542081:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140479104 00000100:00100000:2.0:1788664254.542083:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140479104 00000100:00100000:3.0:1788664254.542084:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140477824:12345-0@lo:400:kworker.0 Request processed in 68us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664254.542092:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788664254.542095:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788664254.542100:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140478720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.542135:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140478720:12345-0@lo:400:kworker.0 Request processed in 35us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664254.542142:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788664254.542154:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788664254.542160:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43ced8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140479232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.542188:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43ced8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140479232:12345-0@lo:400:kworker.0 Request processed in 29us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664254.542201:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788664254.542399:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788664254.542406:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140478592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.542454:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140478592:12345-0@lo:400:kworker.0 Request processed in 48us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664254.542460:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788664254.542473:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788664254.542478:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140479104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.542504:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140479104:12345-0@lo:400:kworker.0 Request processed in 26us (517us total) trans 0 rc 0/0 00010000:00080000:3.0:1788664254.542510:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b72a00 x1875550140478592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664254.542510:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788664254.542527:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140478592:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.542531:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140478208 00000100:00100000:2.0:1788664254.542534:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140478208 00010000:00080000:3.0:1788664254.542539:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b9c700 x1875550140479104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664254.542547:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140479104:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.542553:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140478336 00000100:00100000:2.0:1788664254.542555:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140478336 00000100:00100000:2.0:1788664254.542567:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140478848 00000100:00100000:2.0:1788664254.542570:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140478848 00000100:00100000:2.0:1788664254.542581:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140477952 00000100:00100000:2.0:1788664254.542584:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140477952 00000100:00100000:2.0:1788664254.542592:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140478464 00000100:00100000:2.0:1788664254.542594:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140478464 00000100:00100000:2.0:1788664254.542605:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140478976 00000100:00100000:2.0:1788664254.542609:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140478976 00000100:00100000:2.0:1788664254.542623:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788664254.542631:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140478208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.542663:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140478208:12345-0@lo:400:kworker.0 Request processed in 33us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664254.542669:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788664254.542690:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788664254.542696:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140478336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.542728:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140478336:12345-0@lo:400:kworker.0 Request processed in 33us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664254.542735:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788664254.542746:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788664254.542752:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140478848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.542805:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140478848:12345-0@lo:400:kworker.0 Request processed in 53us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664254.542811:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788664254.542823:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788664254.542829:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140477952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.542861:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140477952:12345-0@lo:400:kworker.0 Request processed in 33us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664254.542862:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140478080 00000100:00100000:3.0:1788664254.542866:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140478080 00000100:00100000:2.0:1788664254.542867:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788664254.542877:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788664254.542882:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140478464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664254.542896:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788664254.542902:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140478080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.542921:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140478464:12345-0@lo:400:kworker.0 Request processed in 39us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664254.542927:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788664254.542939:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788664254.542945:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140478976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664254.542947:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140478080:12345-0@lo:400:kworker.0 Request processed in 46us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664254.542960:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788664254.542969:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140478976:12345-0@lo:400:kworker.0 Request processed in 25us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664254.542975:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:2.0:1788664254.543002:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788664254.543008:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664254.543010:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664254.543012:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664254.543032:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140477824:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.543045:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140478336:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.543055:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140478848:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.543066:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140478208:0@lo:400:kworker.0 00010000:00080000:2.0:1788664254.543076:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b72d80 x1875550140478720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664254.543085:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140478720:0@lo:400:kworker.0 00010000:00080000:2.0:1788664254.543095:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b9d500 x1875550140479232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664254.543102:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140479232:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.543136:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140478080:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.543145:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140477952:0@lo:400:kworker.0 00010000:00080000:2.0:1788664254.543153:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b46300 x1875550140478464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664254.543161:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140478464:0@lo:400:kworker.0 00010000:00080000:2.0:1788664254.543170:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b9c000 x1875550140478976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664254.543178:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140478976:0@lo:400:kworker.0 00000100:00100000:2.0:1788664254.544567:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140479360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664254.544647:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664254.544760:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140479360 00000100:00100000:1.0:1788664254.544792:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140479360 00000100:00100000:1.0:1788664254.544845:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788664254.544856:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140479360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664254.544892:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664254.544953:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140479360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664254.544961:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:2.0:1788664254.545067:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a0b800 x1875550140479360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664254.545091:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140479360:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788664254.912118:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664255.042286:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4367f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140479488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788664255.042419:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664255.043028:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140479488 00000100:00100000:0.0:1788664255.043041:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140479488 00000100:00100000:0.0:1788664255.043117:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788664255.043128:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140479488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664255.043164:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664255.043244:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140479488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664255.043252:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1788664255.043349:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4367f4380 x1875550140479488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664255.043375:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4367f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140479488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664255.127103:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664255.131477:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664255.131516:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664255.131547:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664255.131572:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664255.131622:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119416832 00000100:00100000:2.0:1788664255.131635:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119416832 00000100:00100000:3.0:1788664255.131642:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119417088 00000100:00100000:3.0:1788664255.131649:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119417088 00000100:00100000:3.0:1788664255.131709:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119416704 00000100:00100000:3.0:1788664255.131712:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119416704 00000100:00080000:1.0:1788664255.131765:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788664255.131786:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788664255.134240:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119416576 00000100:00100000:0.0:1788664255.134254:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119416576 00000100:00100000:2.0:1788664255.138589:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119416960 00000100:00100000:2.0:1788664255.138607:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119416960 00000100:00100000:2.0:1788664255.138693:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:2.0:1788664255.138705:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119417088:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664255.138817:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119417088:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 115us (7301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664255.138825:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:2.0:1788664255.138843:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 225 00000100:00100000:2.0:1788664255.138850:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119416832:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664255.138879:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119416832:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (7412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664255.138885:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 225 00000100:00100000:2.0:1788664255.138898:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 226 00000100:00100000:2.0:1788664255.138917:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2390:x1875550119416704:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664255.138958:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2390:x1875550119416704:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 53us (7410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664255.138964:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 226 00000100:00100000:2.0:1788664255.138977:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 227 00000100:00100000:2.0:1788664255.138983:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119416960:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664255.139004:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119416960:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 22us (7431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664255.139010:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 227 00000100:00080000:2.0:1788664255.139035:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664255.139103:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 338 00000100:00100000:2.0:1788664255.139110:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119416576:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664255.139136:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119416576:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (12046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664255.139142:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 338 00000100:00100000:2.0:1788664255.550558:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664255.550582:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140479616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788664255.550657:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664255.550806:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140479616 00000100:00100000:3.0:1788664255.550815:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140479616 00000100:00100000:3.0:1788664255.550865:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788664255.550874:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140479616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788664255.550922:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788664255.550981:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140479616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664255.550989:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788664255.551258:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140479616:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788664255.934764:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664256.064000:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664256.064028:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140479744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788664256.064114:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664256.064264:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140479744 00000100:00100000:1.0:1788664256.064272:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140479744 00000100:00100000:1.0:1788664256.064476:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788664256.064484:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664256.064487:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140479744:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664256.064499:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140479872:0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664256.064518:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664256.064535:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664256.064562:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140479744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664256.064569:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:0.0:1788664256.068167:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f781f80 x1875550140479744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664256.068197:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140479744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788664256.070872:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140479872 00000100:00100000:1.0:1788664256.070886:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140479872 00000100:00100000:2.0:1788664256.071896:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788664256.071924:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140479872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664256.071956:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664256.072308:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140479872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 389us (7771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664256.072334:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1788664256.076308:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b9fb80 x1875550140479872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664256.076336:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140479872:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788664256.080944:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788664256.961698:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664257.983895:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664259.008040:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664259.134057:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664259.134092:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140480000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664259.136949:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664259.137113:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140480000 00000100:00100000:3.0:1788664259.137123:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140480000 00000100:00100000:3.0:1788664259.137207:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788664259.137232:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140480000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664259.137277:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788664259.137382:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140480000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664259.137389:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788664259.137515:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140480000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664259.647019:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140480128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664259.647136:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664259.647208:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140480640:0@lo:400:kworker.0 00000100:00100000:0.0:1788664259.647234:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664259.647254:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140481152:0@lo:400:kworker.0 00000100:00100000:0.0:1788664259.647276:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664259.647289:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140480256:0@lo:400:kworker.0 00000100:00100000:0.0:1788664259.647292:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788664259.647297:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140480512:0@lo:400:kworker.0 00000100:00100000:3.0:1788664259.647320:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664259.647412:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140480640 00000100:00100000:2.0:1788664259.647420:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140480640 00000100:00100000:2.0:1788664259.647466:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788664259.647471:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140480256 00000100:00100000:2.0:1788664259.647475:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140480640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664259.647475:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140480256 00000100:00100000:1.0:1788664259.647501:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788664259.647506:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140480256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664259.649524:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664259.649663:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140481024:0@lo:400:kworker.0 00000100:00100000:0.0:1788664259.649803:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664259.649818:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140481536:0@lo:400:kworker.0 00000100:00100000:0.0:1788664259.649832:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664259.649862:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140480128 00000100:00100000:0.0:1788664259.649868:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140480128 00000100:00100000:0.0:1788664259.649993:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788664259.650003:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140480128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664259.650033:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664259.650076:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140480128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (2940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664259.650084:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788664259.650121:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140481152 00000100:00100000:0.0:1788664259.650125:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140481152 00000100:00100000:0.0:1788664259.650222:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140481024 00000100:00100000:0.0:1788664259.650225:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140481024 00000100:00100000:0.0:1788664259.650240:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140481536 00000100:00100000:0.0:1788664259.650242:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140481536 00000100:00100000:0.0:1788664259.650254:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788664259.650260:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140481152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664259.650297:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140481152:12345-0@lo:400:kworker.0 Request processed in 37us (3019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664259.650303:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788664259.650315:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788664259.650321:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140481024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664259.650476:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140481024:12345-0@lo:400:kworker.0 Request processed in 155us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664259.650483:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788664259.650496:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788664259.650502:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140481536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664259.650540:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140481536:12345-0@lo:400:kworker.0 Request processed in 38us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664259.650546:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1788664259.652080:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788664259.652089:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788664259.652147:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42d9a8700 x1875550140481024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664259.652161:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140481024:0@lo:400:kworker.0 00010000:00080000:0.0:1788664259.652173:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42d9a9f80 x1875550140481536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664259.652196:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140481536:0@lo:400:kworker.0 00010000:00080000:0.0:1788664259.652209:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42d9a8a80 x1875550140481152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664259.652217:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140481152:0@lo:400:kworker.0 00010000:00080000:0.0:1788664259.652228:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f783480 x1875550140480128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664259.652245:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140480128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664259.652889:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140480512 00000100:00100000:0.0:1788664259.652899:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140480512 00000100:00100000:0.0:1788664259.652971:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788664259.652980:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140480512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664259.653065:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140480512:12345-0@lo:400:kworker.0 Request processed in 87us (3739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664259.653073:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788664259.653110:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140480512:0@lo:400:kworker.0 00000100:00100000:2.0:1788664259.654939:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140480640:12345-0@lo:400:kworker.0 Request processed in 7458us (7697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664259.654952:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788664259.655054:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140480640:0@lo:400:kworker.0 00000100:00100000:2.0:1788664259.655869:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140480384:0@lo:400:kworker.0 00000100:00100000:2.0:1788664259.655938:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664259.655986:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140480896:0@lo:400:kworker.0 00000100:00100000:2.0:1788664259.656010:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664259.656033:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140481408:0@lo:400:kworker.0 00000100:00100000:2.0:1788664259.656058:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664259.656091:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140480384 00000100:00100000:2.0:1788664259.656098:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140480384 00000100:00100000:2.0:1788664259.656129:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140480896 00000100:00100000:2.0:1788664259.656132:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140480896 00000100:00100000:2.0:1788664259.656156:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140481408 00000100:00100000:2.0:1788664259.656159:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140481408 00000100:00100000:0.0:1788664259.656457:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788664259.656469:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140480384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664259.656528:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140480384:12345-0@lo:400:kworker.0 Request processed in 62us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664259.656535:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788664259.656552:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788664259.656603:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788664259.656714:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140480896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664259.656750:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140480896:12345-0@lo:400:kworker.0 Request processed in 177us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664259.656756:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788664259.656900:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140481408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664259.656937:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140481408:12345-0@lo:400:kworker.0 Request processed in 328us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664259.656944:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788664259.657055:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140480384:0@lo:400:kworker.0 00010000:00080000:2.0:1788664259.657069:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42e88a680 x1875550140480896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664259.657079:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140480896:0@lo:400:kworker.0 00010000:00080000:2.0:1788664259.657089:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42d9a9880 x1875550140481408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664259.657098:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140481408:0@lo:400:kworker.0 00000100:00080000:2.0:1788664259.657123:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788664259.657599:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140480768:0@lo:400:kworker.0 00000100:00100000:3.0:1788664259.657898:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664259.657991:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140481280:0@lo:400:kworker.0 00000100:00100000:3.0:1788664259.658018:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664259.658292:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140480768 00000100:00100000:0.0:1788664259.658300:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140480768 00000100:00100000:0.0:1788664259.658350:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140481280 00000100:00100000:0.0:1788664259.658354:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140481280 00000100:00100000:0.0:1788664259.658378:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788664259.658386:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140480768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664259.658431:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140480768:12345-0@lo:400:kworker.0 Request processed in 46us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664259.658438:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788664259.658452:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788664259.658458:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140481280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664259.658484:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140481280:12345-0@lo:400:kworker.0 Request processed in 27us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664259.658489:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:3.0:1788664259.658545:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664259.658572:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140480768:0@lo:400:kworker.0 00000100:00100000:3.0:1788664259.658582:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140481280:0@lo:400:kworker.0 00000100:00100000:1.0:1788664259.660022:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140480256:12345-0@lo:400:kworker.0 Request processed in 12509us (12694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664259.660035:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788664259.661050:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140480256:0@lo:400:kworker.0 00010000:00010000:2.0:1788664260.031267:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664260.158120:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664260.158143:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140481664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664260.158223:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664260.158906:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140481664 00000100:00100000:2.0:1788664260.158915:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140481664 00000100:00100000:2.0:1788664260.158982:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788664260.158991:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140481664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788664260.159015:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664260.159068:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140481664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664260.159075:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:2.0:1788664260.159113:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b9e300 x1875550140481664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664260.159130:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140481664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664260.249881:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664260.249921:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664260.249947:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119417216 00000100:00100000:0.0:1788664260.249948:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664260.249960:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119417216 00000100:00100000:0.0:1788664260.249979:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664260.250005:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664260.250018:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 340 00000100:00100000:3.0:1788664260.250031:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2391:x1875550119417216:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664260.250033:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119417472 00000100:00100000:0.0:1788664260.250040:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119417472 00000100:00100000:0.0:1788664260.250082:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119417728 00000100:00100000:0.0:1788664260.250086:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119417728 00000100:00100000:0.0:1788664260.250103:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119417344 00000100:00100000:3.0:1788664260.250108:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2391:x1875550119417216:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 80us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664260.250115:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119417344 00000100:00100000:3.0:1788664260.250120:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 340 00000100:00100000:0.0:1788664260.250136:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119417600 00000100:00100000:0.0:1788664260.250140:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119417600 00000100:00100000:0.0:1788664260.250158:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 234 00000100:00100000:0.0:1788664260.250167:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119417472:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664260.250174:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 235 00000100:00100000:3.0:1788664260.250184:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119417728:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664260.250205:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119417472:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 39us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664260.250213:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 234 00000100:00100000:3.0:1788664260.250228:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119417728:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 45us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664260.250231:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 236 00000100:00100000:3.0:1788664260.250241:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 235 00000100:00100000:0.0:1788664260.250247:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119417344:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664260.250272:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00100000:0.0:1788664260.250279:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119417344:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 36us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664260.250283:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119417600:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664260.250293:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 236 00000100:00100000:3.0:1788664260.250316:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119417600:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664260.250326:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00080000:3.0:1788664260.250350:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664260.250354:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664260.670073:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664260.670101:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140481792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788664260.670174:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664260.670279:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140481792 00000100:00100000:3.0:1788664260.670287:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140481792 00000100:00100000:3.0:1788664260.670341:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788664260.670351:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140481792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788664260.670400:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788664260.670467:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140481792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664260.670484:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788664260.670532:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140481792:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788664260.952742:0:13531:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:10:59 (1788664259) === 00010000:00010000:2.0:1788664261.053958:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664261.182536:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664261.182559:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42d9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140481920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664261.182626:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664261.182697:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140481920 00000100:00100000:3.0:1788664261.182703:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140481920 00000100:00100000:3.0:1788664261.182764:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788664261.182796:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140481920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788664261.182826:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664261.182882:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140481920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664261.182890:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1788664261.182911:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788664261.182950:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42d9a8000 x1875550140481920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664261.182968:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42d9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140481920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664261.183479:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664261.183492:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140482048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664261.183530:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664261.183921:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140482048 00000100:00100000:2.0:1788664261.183942:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140482048 00000100:00100000:2.0:1788664261.183999:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788664261.184008:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140482048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664261.184028:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664261.184071:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140482048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664261.184077:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:2.0:1788664261.184108:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b9c380 x1875550140482048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664261.184125:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140482048:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788664261.184182:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664261.379578:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664261.379624:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664261.380758:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119417856 00000100:00100000:0.0:1788664261.380795:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119417856 00000100:00100000:0.0:1788664261.380859:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1788664261.380879:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119417856:12345-192.168.203.52@tcp:41:mkdir.0 00000004:00000024:0.0:1788664261.380922:0:9169:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788664261.381007:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119417856:12345-192.168.203.52@tcp:41:mkdir.0 Request processed in 130us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664261.381016:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1788664261.382859:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119417984 00000100:00100000:0.0:1788664261.382881:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119417984 00000100:00100000:0.0:1788664261.382953:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1788664261.382970:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:10479:x1875550119417984:12345-192.168.203.52@tcp:700:mkdir.0 00000100:00100000:0.0:1788664261.383061:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:10479:x1875550119417984:12345-192.168.203.52@tcp:700:mkdir.0 Request processed in 93us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664261.383069:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1788664261.385945:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664261.386038:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119418240 00000100:00100000:0.0:1788664261.386048:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119418240 00000100:00100000:0.0:1788664261.386142:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1788664261.386153:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:10479:x1875550119418240:12345-192.168.203.52@tcp:36:mkdir.0 00010000:00010000:0.0:1788664261.386209:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664261.386278:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee400/0xcd11f61c1413d73a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d18f expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.386307:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c435166100) 00010000:00010000:0.0:1788664261.386320:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664261.386423:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956e00/0xcd11f61c1413d898 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.386594:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956e00/0xcd11f61c1413d898 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.386605:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956e00/0xcd11f61c1413d898 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.386636:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413d89f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.386655:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413d89f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.386679:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413d89f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.387264:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d8a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.387275:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d8a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.387292:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d8a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664261.387307:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012afddfb reply state 00000000d3f0e299 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d8a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.387317:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d8a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.387323:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93c303887300) 00010000:00010000:0.0:1788664261.387326:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788664261.387328:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788664261.387332:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788664261.387339:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956e00/0xcd11f61c1413d898 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.387345:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956e00/0xcd11f61c1413d898 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.387352:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956e00/0xcd11f61c1413d898 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.387358:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956e00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664261.387368:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956e00/0xcd11f61c1413d898 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.387376:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956e00/0xcd11f61c1413d898 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.387385:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c303887000) 00010000:00010000:0.0:1788664261.387388:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664261.387391:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956e00/0xcd11f61c1413d898 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.387397:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956e00/0xcd11f61c1413d898 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664261.387411:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012afddfb reply state 00000000d3f0e299 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413d89f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.387420:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413d89f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.388853:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93c303887200) 00010000:00010000:0.0:1788664261.388857:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788664261.388870:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788664261.388985:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:10479:x1875550119418240:12345-192.168.203.52@tcp:36:mkdir.0 Request processed in 2830us (3045us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788664261.388995:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1788664261.403610:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664261.404012:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119418368 00000100:00100000:2.0:1788664261.404026:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119418368 00000100:00100000:2.0:1788664261.404090:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1788664261.404100:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:10480:x1875550119418368:12345-192.168.203.52@tcp:101:chmod.0 00010000:00010000:2.0:1788664261.404132:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664261.404159:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d8ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d222 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.404228:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413d8b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.404245:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413d8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.404269:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413d8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664261.404317:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788664261.404334:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664261.404380:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413d8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.404404:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d8ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d222 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.404424:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413d8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d222 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.404433:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4130a6100) 00010000:00010000:2.0:1788664261.404436:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664261.404439:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c600, rc 0) 00000100:00100000:2.0:1788664261.404499:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:10480:x1875550119418368:12345-192.168.203.52@tcp:101:chmod.0 Request processed in 399us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664261.404506:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1788664261.410618:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664261.410709:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119418624 00000100:00100000:2.0:1788664261.410720:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119418624 00000100:00100000:2.0:1788664261.410799:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:2.0:1788664261.410809:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:10480:x1875550119418624:12345-192.168.203.52@tcp:36:chmod.0 00010000:00010000:2.0:1788664261.410871:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664261.410898:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413d8b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d222 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.410917:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4130a6100) 00010000:00010000:2.0:1788664261.410926:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664261.410951:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d8bb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.410979:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d8bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.410988:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d8bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664261.411169:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6f6f971 reply state 0000000004a448ec transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d8bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.411181:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d8bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.411187:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4130a6c00) 00010000:00010000:2.0:1788664261.411190:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788664261.411192:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788664261.411199:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788664261.411286:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:10480:x1875550119418624:12345-192.168.203.52@tcp:36:chmod.0 Request processed in 478us (677us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788664261.411293:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1788664261.450693:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664261.454832:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119418752 00000100:00100000:0.0:1788664261.454849:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119418752 00000100:00100000:0.0:1788664261.454982:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:0.0:1788664261.454994:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:10481:x1875550119418752:12345-192.168.203.52@tcp:101:chown.0 00010000:00010000:0.0:1788664261.455035:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664261.455057:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956e00/0xcd11f61c1413d8c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d229 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.455127:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413d8c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.455141:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413d8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.455152:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413d8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664261.455192:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788664261.455196:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788664261.455247:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413d8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.455295:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956e00/0xcd11f61c1413d8c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d229 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.455315:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413d8c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d229 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.455324:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4130a6c00) 00010000:00010000:0.0:1788664261.455327:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664261.455331:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956200, rc 0) 00000100:00100000:0.0:1788664261.455567:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:10481:x1875550119418752:12345-192.168.203.52@tcp:101:chown.0 Request processed in 574us (4883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664261.455575:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:2.0:1788664261.464020:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664261.464100:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119418880 00000100:00100000:0.0:1788664261.464120:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119418880 00000100:00100000:0.0:1788664261.464179:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:0.0:1788664261.464189:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:10481:x1875550119418880:12345-192.168.203.52@tcp:101:chown.0 00010000:00010000:0.0:1788664261.464212:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664261.464245:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d230 expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464310:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413d8d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464323:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413d8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464334:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413d8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464345:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413d8de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464352:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413d8de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464357:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413d8de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464423:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413d8e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464442:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464465:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664261.464504:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788664261.464508:0:9169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788664261.464527:0:9169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464537:0:9169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413d8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464543:0:9169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413d8d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464549:0:9169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413d8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464554:0:9169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664261.464558:0:9169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413d8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464566:0:9169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413d8d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464578:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4130a6c00) 00010000:00010000:0.0:1788664261.464581:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664261.464586:0:9169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413d8d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464592:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413d8d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464616:0:9169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413d8de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464621:0:9169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413d8de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464627:0:9169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413d8de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464631:0:9169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957a00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664261.464634:0:9169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413d8de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464639:0:9169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413d8de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464646:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93c303887200) 00010000:00010000:0.0:1788664261.464649:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664261.464653:0:9169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413d8de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464658:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413d8de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464685:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d230 expref: 12 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464698:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413d8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d230 expref: 11 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.464717:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93c303887300) 00010000:00010000:0.0:1788664261.464719:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664261.464722:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956400, rc 0) 00000100:00100000:0.0:1788664261.464806:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:10481:x1875550119418880:12345-192.168.203.52@tcp:101:chown.0 Request processed in 618us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664261.464814:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788664261.480954:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664261.481053:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119419008 00000100:00100000:2.0:1788664261.481064:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119419008 00000100:00100000:2.0:1788664261.481125:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1788664261.481323:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:10481:x1875550119419008:12345-192.168.203.52@tcp:900:chown.0 00000100:00100000:2.0:1788664261.481418:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:10481:x1875550119419008:12345-192.168.203.52@tcp:900:chown.0 Request processed in 285us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664261.481435:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1788664261.487420:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664261.487944:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119419264 00000100:00100000:0.0:1788664261.487954:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119419264 00000100:00100000:0.0:1788664261.488016:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:0.0:1788664261.488026:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:10481:x1875550119419264:12345-192.168.203.52@tcp:36:chown.0 00010000:00010000:0.0:1788664261.488081:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664261.488108:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413d8e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d230 expref: 11 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.488138:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93c303887300) 00010000:00010000:0.0:1788664261.488143:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664261.488164:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.488178:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.488189:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788664261.498155:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1788664261.498324:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413d89f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498355:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413d89f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498362:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413d89f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498369:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664261.498373:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413d89f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498382:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413d89f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498399:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93c303887200) 00010000:00010000:0.0:1788664261.498403:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664261.498408:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413d89f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498414:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413d89f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498445:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d8a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498452:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d8a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498458:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d8a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498463:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664261.498472:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d8a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498478:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d8a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498485:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93c303887300) 00010000:00010000:0.0:1788664261.498488:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664261.498490:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d8a6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498496:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d8a6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498509:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d8bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498516:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d8bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498521:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d8bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498526:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ce00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664261.498529:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d8bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498535:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d8bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498543:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4130a6c00) 00010000:00010000:0.0:1788664261.498545:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788664261.498555:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d8bb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.498561:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d8bb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664261.508393:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c11c7e46 reply state 00000000cf21f48b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.508439:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.508448:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93c303887300) 00010000:00010000:2.0:1788664261.508451:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788664261.508456:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788664261.508532:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1788664261.508724:0:6513:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788664261.508751:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:10481:x1875550119419264:12345-192.168.203.52@tcp:36:chown.0 Request processed in 20723us (21336us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788664261.508760:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00010000:00010000:0.0:1788664261.508923:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.508933:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.508941:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.508947:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664261.508952:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.508961:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.508972:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93c303887300) 00010000:00010000:0.0:1788664261.508975:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788664261.508979:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8ec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.508985:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8ec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664261.527542:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664261.527638:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119419392 00000100:00100000:0.0:1788664261.527648:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119419392 00000100:00100000:0.0:1788664261.527712:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:0.0:1788664261.527733:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:10482:x1875550119419392:12345-192.168.203.52@tcp:101:touch.500 00010000:00010000:0.0:1788664261.527756:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664261.527810:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d237 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788664261.530959:0:6511:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3084us 00010000:00010000:1.0:1788664261.543897:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85e00/0xcd11f61c1413d8fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.543921:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85e00/0xcd11f61c1413d8fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.543933:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85e00/0xcd11f61c1413d8fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.543948:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413d901 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.543955:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413d901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.543961:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413d901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544106:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413d908 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544114:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413d908 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544121:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413d908 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664261.544163:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788664261.544168:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664261.544204:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413d908 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544216:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85e00/0xcd11f61c1413d8fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544382:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85e00/0xcd11f61c1413d8fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544389:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85e00/0xcd11f61c1413d8fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544396:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85e00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664261.544400:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85e00/0xcd11f61c1413d8fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544408:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85e00/0xcd11f61c1413d8fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544420:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4130a6c00) 00010000:00010000:1.0:1788664261.544423:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664261.544428:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85e00/0xcd11f61c1413d8fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544435:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85e00/0xcd11f61c1413d8fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544447:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413d901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544453:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413d901 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544523:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413d901 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544528:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84c00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664261.544537:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413d901 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544544:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413d901 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544553:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93c41313ef00) 00010000:00010000:1.0:1788664261.544555:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664261.544558:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413d901 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544564:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413d901 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544602:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413d8f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d237 expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544617:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413d908 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d237 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.544624:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93c41313ed00) 00010000:00010000:1.0:1788664261.544626:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788664261.544629:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85600, rc 0) 00000100:00100000:1.0:1788664261.544796:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:10482:x1875550119419392:12345-192.168.203.52@tcp:101:touch.500 Request processed in 17063us (17262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664261.544806:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:3.0:1788664261.551101:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664261.551177:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119419648 00000100:00100000:2.0:1788664261.551188:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119419648 00000100:00100000:2.0:1788664261.551246:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:2.0:1788664261.551257:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:10482:x1875550119419648:12345-192.168.203.52@tcp:101:touch.500 00010000:00010000:2.0:1788664261.551277:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664261.551298:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413d90f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d23e expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.551406:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413d916 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.551422:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413d916 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.551447:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413d916 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.551488:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d91d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.551514:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d91d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.551522:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d91d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788664261.551924:0:9524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788664261.552070:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413d924 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.552079:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413d924 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.552087:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413d924 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.552119:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413d916 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.552126:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413d916 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.552133:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413d916 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.552140:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0d600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664261.552145:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413d916 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.552152:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413d916 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.552176:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93c41313ed00) 00010000:00010000:2.0:1788664261.552179:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664261.552184:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413d916 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.552191:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413d916 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664261.552204:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001acb238c reply state 00000000e973e36c transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d91d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.552214:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d91d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.552221:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe41446a2 (ffff93c4130a6100) 00010000:00010000:2.0:1788664261.552224:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788664261.552226:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788664261.552255:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413d90f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d23e expref: 10 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.552270:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413d924 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d23e expref: 9 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.552277:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93c4130a6d00) 00010000:00010000:2.0:1788664261.552279:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664261.552282:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c400, rc 0) 00000100:00100000:2.0:1788664261.552355:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:10482:x1875550119419648:12345-192.168.203.52@tcp:101:touch.500 Request processed in 1100us (1263us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788664261.552363:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1788664261.557613:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664261.557831:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119419904 00000100:00100000:0.0:1788664261.557841:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119419904 00000100:00100000:0.0:1788664261.557902:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:0.0:1788664261.557912:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:10482:x1875550119419904:12345-192.168.203.52@tcp:36:touch.500 00010000:00010000:0.0:1788664261.557970:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664261.557999:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413d924 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d23e expref: 10 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.558018:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93c4130a6d00) 00010000:00010000:0.0:1788664261.558029:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664261.558087:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d932 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.558100:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.558109:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664261.558208:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016f5d9b1 reply state 00000000c7b053f1 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.558221:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d932 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.558246:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93c303887300) 00010000:00010000:0.0:1788664261.558248:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788664261.558251:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788664261.558344:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:10482:x1875550119419904:12345-192.168.203.52@tcp:36:touch.500 Request processed in 433us (740us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788664261.558351:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:1.0:1788664261.564717:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664261.564937:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119420032 00000100:00100000:2.0:1788664261.564948:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119420032 00000100:00100000:2.0:1788664261.565007:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:2.0:1788664261.565017:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:10482:x1875550119420032:12345-192.168.203.52@tcp:101:touch.500 00010000:00010000:2.0:1788664261.565040:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664261.565057:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413d939 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d245 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.565116:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413d939 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d245 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.565129:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413d939 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d245 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.565147:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93c303887300) 00010000:00010000:2.0:1788664261.565150:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788664261.565153:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c600, rc 0) 00000100:00100000:2.0:1788664261.565214:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+12:10482:x1875550119420032:12345-192.168.203.52@tcp:101:touch.500 Request processed in 199us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664261.565221:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:3.0:1788664261.574965:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664261.575198:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119420160 00000100:00100000:0.0:1788664261.575210:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119420160 00000100:00100000:0.0:1788664261.575258:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1788664261.575266:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1875550119420160:12345-192.168.203.52@tcp:8:touch.500 00010000:00080000:0.0:1788664261.575304:0:8429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:0.0:1788664261.575334:0:8429:0:(genops.c:1385:class_connect()) connect: client b07edea8-5696-4cd5-9a12-cefd3a8358e9, cookie 0xcd11f61c1413d940 00002000:00100000:0.0:1788664261.575344:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b07edea8-5696-4cd5-9a12-cefd3a8358e9/ffff93c435138800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788664261.575361:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788664261.575442:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788664261.575472:0:8429:0:(import.c:65:import_set_state_nolock()) ffff93c43513d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788664261.575542:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2389:x1875550119420160:12345-192.168.203.52@tcp:8:touch.500 Request processed in 276us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664261.575550:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1788664261.583555:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664261.585404:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119420288 00000100:00100000:2.0:1788664261.585419:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119420288 00000100:00100000:2.0:1788664261.585501:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:2.0:1788664261.585511:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:0:x1875550119420288:12345-192.168.203.52@tcp:2:touch.500 00000100:00080000:3.0:1788664261.585553:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788664261.587893:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:3.0:1788664261.587908:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000100:00100000:2.0:1788664261.588137:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:0:x1875550119420288:12345-192.168.203.52@tcp:2:touch.500 Request processed in 2622us (4586us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788664261.588149:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1788664261.590809:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664261.590901:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119420544 00000100:00100000:3.0:1788664261.590911:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119420544 00000100:00100000:3.0:1788664261.590971:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1788664261.590981:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+12:10482:x1875550119420544:12345-192.168.203.52@tcp:35:touch.500 00000100:00100000:3.0:1788664261.591614:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:10482:x1875550119420544:12345-192.168.203.52@tcp:35:touch.500 Request processed in 631us (848us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788664261.591623:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1788664261.612961:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664261.613260:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119420672 00000100:00100000:3.0:1788664261.613270:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119420672 00000100:00100000:3.0:1788664261.613372:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1788664261.613383:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:10483:x1875550119420672:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:3.0:1788664261.613410:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664261.613430:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d947 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d24c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.613511:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d94e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.613528:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d94e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.613540:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d94e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664261.613588:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788664261.613592:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788664261.613631:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d94e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.613657:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d24c expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.613675:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d94e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d24c expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.613695:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93c41313ed00) 00010000:00010000:3.0:1788664261.613698:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788664261.613702:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351ee000, rc 0) 00000100:00100000:3.0:1788664261.616194:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:10483:x1875550119420672:12345-192.168.203.52@tcp:101:rm.0 Request processed in 2801us (3230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664261.616208:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1788664261.625348:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664261.625440:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119420928 00000100:00100000:1.0:1788664261.625450:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119420928 00000100:00100000:1.0:1788664261.625590:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1788664261.625599:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:10483:x1875550119420928:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:1.0:1788664261.625620:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664261.625639:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85a00/0xcd11f61c1413d955 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d253 expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664261.625735:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788664261.625920:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85a00/0xcd11f61c1413d955 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d253 expref: 16 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.625935:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4130a6c00) 00010000:00010000:1.0:1788664261.625938:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788664261.625942:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85a00/0xcd11f61c1413d955 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d253 expref: 16 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664261.625956:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85a00, rc 0) 00000100:00100000:1.0:1788664261.626005:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:10483:x1875550119420928:12345-192.168.203.52@tcp:101:rm.0 Request processed in 407us (666us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1788664261.626012:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1788664261.634873:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664261.634978:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119421056 00000100:00100000:2.0:1788664261.634990:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119421056 00000100:00100000:2.0:1788664261.635098:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788664261.635110:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:10483:x1875550119421056:12345-192.168.203.52@tcp:37:rm.0 00000100:00100000:2.0:1788664261.641711:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:10483:x1875550119421056:12345-192.168.203.52@tcp:37:rm.0 Request processed in 6591us (6848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664261.641725:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:0.0:1788664261.646872:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664261.646942:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119421312 00000100:00100000:3.0:1788664261.646952:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119421312 00000100:00100000:3.0:1788664261.647041:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1788664261.647050:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c406b62c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:10483:x1875550119421312:12345-192.168.203.52@tcp:35:rm.0 00000100:00100000:3.0:1788664261.647282:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c406b62c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+16:10483:x1875550119421312:12345-192.168.203.52@tcp:35:rm.0 Request processed in 233us (429us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788664261.647290:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1788664261.653743:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664261.653886:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119421568 00000100:00100000:3.0:1788664261.653897:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119421568 00000100:00100000:3.0:1788664261.653996:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:3.0:1788664261.654006:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+16:10483:x1875550119421568:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:3.0:1788664261.654031:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664261.654050:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d963 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d25a expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.654178:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee400/0xcd11f61c1413d96a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.654194:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee400/0xcd11f61c1413d96a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.654218:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee400/0xcd11f61c1413d96a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664261.654229:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788664261.654350:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d963 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d25a expref: 19 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.654370:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee400/0xcd11f61c1413d96a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d25a expref: 18 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.654380:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93c41313ed00) 00010000:00010000:3.0:1788664261.654383:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788664261.654387:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351ee400, rc 0) 00000100:00100000:3.0:1788664261.654462:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:10483:x1875550119421568:12345-192.168.203.52@tcp:101:rm.0 Request processed in 458us (728us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788664261.654470:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788664261.658293:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664261.658888:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119421696 00000100:00100000:3.0:1788664261.658899:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119421696 00000100:00100000:3.0:1788664261.658964:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:3.0:1788664261.658974:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:10483:x1875550119421696:12345-192.168.203.52@tcp:41:rm.0 00000004:00000024:3.0:1788664261.659030:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1788664261.659107:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:10483:x1875550119421696:12345-192.168.203.52@tcp:41:rm.0 Request processed in 134us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664261.659114:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:1.0:1788664261.662856:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664261.662960:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119421824 00000100:00100000:2.0:1788664261.662971:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119421824 00000100:00100000:2.0:1788664261.663033:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:2.0:1788664261.663044:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:10483:x1875550119421824:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:2.0:1788664261.663066:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664261.663086:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413d978 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d261 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663174:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413d97f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663189:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413d97f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663198:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413d97f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663206:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413d986 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663210:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413d986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663228:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413d986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663305:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413d98d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663313:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413d98d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663319:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413d98d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664261.663354:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788664261.663360:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664261.663378:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413d98d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663391:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413d98d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663399:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413d97f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663405:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413d97f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663412:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413d97f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663418:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ca00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664261.663550:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413d97f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663566:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413d97f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663578:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93c41313ed00) 00010000:00010000:2.0:1788664261.663581:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664261.663586:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413d97f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663652:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413d97f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663669:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413d986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663675:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413d986 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663681:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413d986 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663685:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0d200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664261.663688:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413d986 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663694:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413d986 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663702:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe41446a2 (ffff93c4130a6100) 00010000:00010000:2.0:1788664261.663705:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664261.663708:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413d986 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663724:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413d986 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663748:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413d978 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d261 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663758:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413d98d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d261 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.663763:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93c303887300) 00010000:00010000:2.0:1788664261.663764:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664261.663766:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c400, rc 0) 00000100:00100000:2.0:1788664261.663890:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:10483:x1875550119421824:12345-192.168.203.52@tcp:101:rm.0 Request processed in 846us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664261.663897:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:1.0:1788664261.668726:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664261.668941:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119422080 00000100:00100000:3.0:1788664261.668951:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119422080 00000100:00100000:3.0:1788664261.669050:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:3.0:1788664261.669059:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:10483:x1875550119422080:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:3.0:1788664261.669118:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788664261.669148:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413d98d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d261 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669166:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413d939 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d245 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669176:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93c303887300) 00010000:00010000:3.0:1788664261.669186:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d94e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d24c expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669193:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93c41313ed00) 00010000:00010000:3.0:1788664261.669196:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664261.669215:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d994 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669228:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d994 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669237:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d994 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669253:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413d99b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669260:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413d99b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669277:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413d99b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669369:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669378:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669385:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788664261.669687:0:9524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788664261.669698:0:9524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 356806926126ns, next at 357806923947ns, rc = 0 00010000:00010000:3.0:1788664261.669748:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413d9a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669756:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413d9a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669765:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413d9a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669800:0:9524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413d9a9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669806:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413d9a9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669811:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413d9a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669838:0:9524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664261.669855:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669872:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9a2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669878:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669884:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ee200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664261.669889:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669896:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9a2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669905:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93c303887300) 00010000:00010000:3.0:1788664261.669908:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788664261.669911:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9a2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669918:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9a2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669932:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d994 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669939:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d994 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669944:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d994 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669958:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ef400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664261.669962:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d994 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669968:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d994 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669976:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93c41313ed00) 00010000:00010000:3.0:1788664261.669978:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664261.669981:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d994 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.669986:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d994 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664261.669995:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021655cfd reply state 00000000c547dfd2 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413d99b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.670005:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413d99b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.670011:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe41446a2 (ffff93c4130a6100) 00010000:00010000:3.0:1788664261.670013:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788664261.670016:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788664261.670090:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:10483:x1875550119422080:12345-192.168.203.52@tcp:36:rm.0 Request processed in 1031us (1375us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788664261.670098:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00010000:00010000:0.0:1788664261.670161:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664261.670173:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413d9a9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.670179:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351eec00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664261.670182:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413d9a9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.670188:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413d9a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.670197:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93c303887300) 00010000:00010000:0.0:1788664261.670199:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788664261.670202:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413d9a9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.670208:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413d9a9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664261.670218:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664261.670220:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664261.670221:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664261.676352:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664261.676827:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119422336 00000100:00100000:2.0:1788664261.676839:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119422336 00000100:00100000:2.0:1788664261.676905:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:2.0:1788664261.676916:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:10483:x1875550119422336:12345-192.168.203.52@tcp:35:rm.0 00000100:00100000:2.0:1788664261.677547:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:10483:x1875550119422336:12345-192.168.203.52@tcp:35:rm.0 Request processed in 630us (1200us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788664261.677556:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788664261.689629:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664261.689810:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119422592 00000100:00100000:3.0:1788664261.689820:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119422592 00000100:00100000:3.0:1788664261.689891:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:3.0:1788664261.689912:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:10483:x1875550119422592:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:3.0:1788664261.689964:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788664261.689988:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee400/0xcd11f61c1413d96a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d25a expref: 19 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.690011:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413d908 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d237 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.690024:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93c41313ed00) 00010000:00010000:3.0:1788664261.690037:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413d8c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d229 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.690046:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4130a6c00) 00010000:00010000:3.0:1788664261.690051:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664261.690073:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d9b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.690085:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d9b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.690095:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d9b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.690106:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.690123:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.690129:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.690238:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d9be lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.690247:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d9be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664261.690253:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d9be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664261.691566:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788664261.691588:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d9be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.691723:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d9be lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.691741:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d9be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.691747:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ee000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664261.691751:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d9be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.691759:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d9be lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.691803:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93c4350d6800) 00010000:00010000:2.0:1788664261.691807:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788664261.691811:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d9be lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.691817:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413d9be lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.691843:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d9b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.691849:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d9b0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.691854:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d9b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.691868:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ef400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664261.691871:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d9b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.691887:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d9b0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.691897:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4350d6600) 00010000:00010000:2.0:1788664261.691900:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664261.691903:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d9b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.691909:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413d9b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664261.691926:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4d63d34 reply state 0000000038418e1c transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.691936:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664261.691943:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93c4350d6700) 00010000:00010000:2.0:1788664261.691945:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788664261.691949:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788664261.692084:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:10483:x1875550119422592:12345-192.168.203.52@tcp:36:rm.0 Request processed in 2170us (2461us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788664261.692092:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00010000:00010000:2.0:1788664262.078254:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664263.103180:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664264.127415:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664264.254013:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664264.254037:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140482176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664264.254141:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664264.254212:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140482176 00000100:00100000:1.0:1788664264.254219:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140482176 00000100:00100000:1.0:1788664264.254280:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788664264.254290:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140482176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788664264.254326:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788664264.254976:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140482176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 685us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664264.254985:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788664264.255082:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140482176:0@lo:41:osp-pre-1-0.0 00000004:00080000:2.0:1788664264.766062:0:9900:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359903288800ns, next at 360903285838ns, rc = 0 00000100:00100000:0.0:1788664264.766172:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788664264.766194:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140482304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664264.766293:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664264.767709:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140482304 00000100:00100000:2.0:1788664264.767721:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140482304 00000100:00100000:2.0:1788664264.767823:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788664264.767836:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140482304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664264.767897:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664264.767959:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140482304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664264.767966:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788664264.768982:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788664264.769025:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b9fb80 x1875550140482304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664264.769047:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140482304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664264.769281:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140482560:0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.769331:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664264.769368:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140483072:0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.769386:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664264.769406:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140483584:0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.769438:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664264.769459:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788664264.769464:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140482688:0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.769489:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664264.769504:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140483200:0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.769523:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664264.769534:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140483712:0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.769548:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664264.769572:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140482560 00000100:00100000:3.0:1788664264.769577:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140482560 00000100:00100000:3.0:1788664264.769614:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140483072 00000100:00100000:3.0:1788664264.769617:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140483072 00000100:00100000:3.0:1788664264.769635:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140483584 00000100:00100000:3.0:1788664264.769637:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140483584 00000100:00100000:3.0:1788664264.769651:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788664264.769657:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140482560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.769696:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140482560:12345-0@lo:400:kworker.0 Request processed in 39us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664264.769702:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788664264.769716:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788664264.769721:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140483072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.769742:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140483072:12345-0@lo:400:kworker.0 Request processed in 22us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664264.769747:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788664264.769756:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788664264.769761:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140483584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664264.771704:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140483200 00000100:00100000:0.0:1788664264.771733:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140483200 00000100:00100000:0.0:1788664264.771818:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140483712 00000100:00100000:0.0:1788664264.771821:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140483712 00000100:00100000:0.0:1788664264.771862:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788664264.771872:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140483200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.772604:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140482688 00000100:00100000:3.0:1788664264.772611:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140482688 00000100:00100000:3.0:1788664264.772652:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788664264.772660:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140482688:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788664264.773088:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664264.773094:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788664264.773097:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788664264.773113:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140482432:0@lo:400:kworker.0 00000100:00100000:2.0:1788664264.774158:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788664264.774175:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140483712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664264.774277:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140483200:12345-0@lo:400:kworker.0 Request processed in 2406us (4751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664264.774285:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788664264.777207:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140482688:12345-0@lo:400:kworker.0 Request processed in 4537us (7706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664264.777222:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788664264.777300:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140482688:0@lo:400:kworker.0 00010000:00080000:3.0:1788664264.777324:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b71f80 x1875550140483200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664264.777356:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140483200:0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.777373:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140482560:0@lo:400:kworker.0 00010000:00080000:3.0:1788664264.777384:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b72680 x1875550140483072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664264.777392:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140483072:0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.777595:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140483584:12345-0@lo:400:kworker.0 Request processed in 7832us (8155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664264.777603:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00010000:00080000:3.0:1788664264.777633:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c301ea8e00 x1875550140483584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664264.777643:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140483584:0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.777670:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140482816:0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.777705:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664264.777738:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140483328:0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.777761:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664264.777820:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140482816 00000100:00100000:3.0:1788664264.777827:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140482816 00000100:00100000:3.0:1788664264.777887:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788664264.777896:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140482816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.777947:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140482816:12345-0@lo:400:kworker.0 Request processed in 52us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664264.777953:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788664264.777987:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140482816:0@lo:400:kworker.0 00000100:00100000:0.0:1788664264.779621:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140483328 00000100:00100000:0.0:1788664264.779633:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140483328 00000100:00100000:0.0:1788664264.779689:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788664264.779698:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140483328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664264.779791:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140483328:12345-0@lo:400:kworker.0 Request processed in 74us (2007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664264.779798:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1788664264.779819:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788664264.783037:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b71c00 x1875550140483328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664264.783057:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140483328:0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.783423:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664264.783472:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140482944:0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.783506:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664264.783574:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140483456:0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.783599:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664264.783627:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140482944 00000100:00100000:3.0:1788664264.783633:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140482944 00000100:00100000:3.0:1788664264.783678:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140483456 00000100:00100000:3.0:1788664264.783681:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140483456 00000100:00100000:3.0:1788664264.783700:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788664264.783707:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140482944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.783753:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140482944:12345-0@lo:400:kworker.0 Request processed in 46us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664264.783760:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788664264.783816:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788664264.783823:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140483456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.783886:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140483456:12345-0@lo:400:kworker.0 Request processed in 63us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664264.783893:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1788664264.783910:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664264.783935:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140483456:0@lo:400:kworker.0 00000100:00100000:3.0:1788664264.783967:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140482944:0@lo:400:kworker.0 00000100:00100000:1.0:1788664264.784141:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140482432 00000100:00100000:1.0:1788664264.784146:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140482432 00000100:00100000:1.0:1788664264.784183:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788664264.784190:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140482432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664264.784226:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140482432:12345-0@lo:400:kworker.0 Request processed in 37us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664264.784231:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788664264.784264:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140482432:0@lo:400:kworker.0 00000100:00100000:2.0:1788664264.784394:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140483712:12345-0@lo:400:kworker.0 Request processed in 10225us (14842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664264.784402:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:2.0:1788664264.784433:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c301eabb80 x1875550140483712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664264.784444:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140483712:0@lo:400:kworker.0 00010000:00010000:2.0:1788664265.150766:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664265.279908:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664265.279934:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140483840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664265.280004:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664265.280094:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140483840 00000100:00100000:0.0:1788664265.280102:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140483840 00000100:00100000:0.0:1788664265.280149:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788664265.280159:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140483840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664265.280182:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664265.280242:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140483840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664265.280250:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:1.0:1788664265.280336:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c301eabb80 x1875550140483840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664265.280385:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140483840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664265.369754:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664265.369833:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664265.369867:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664265.369886:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664265.369904:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664265.369926:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664265.369927:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119422976 00000100:00100000:2.0:1788664265.369940:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119422976 00000100:00100000:2.0:1788664265.370007:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119423232 00000100:00100000:2.0:1788664265.370010:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119423232 00000100:00100000:2.0:1788664265.370023:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119422848 00000100:00100000:2.0:1788664265.370025:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119422848 00000100:00100000:2.0:1788664265.370038:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119423360 00000100:00100000:2.0:1788664265.370041:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119423360 00000100:00100000:3.0:1788664265.370059:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 244 00000100:00100000:0.0:1788664265.370103:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119422720 00000100:00100000:0.0:1788664265.370108:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119422720 00000100:00100000:0.0:1788664265.370138:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 342 00000100:00100000:0.0:1788664265.370145:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2393:x1875550119422720:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664265.370225:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2393:x1875550119422720:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 80us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664265.370233:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 342 00000100:00100000:0.0:1788664265.370263:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119423104 00000100:00100000:0.0:1788664265.370266:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119423104 00000100:00100000:0.0:1788664265.370291:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:0.0:1788664265.370297:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119423104:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664265.370324:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119423104:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664265.370330:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:3.0:1788664265.370400:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119422976:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664265.370429:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119422976:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 361us (596us total) trans 0 rc 0/0 00000100:00080000:1.0:1788664265.370469:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664265.370474:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788664265.370476:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664265.370571:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 245 00000100:00100000:2.0:1788664265.370582:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119423232:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664265.370618:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119423232:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 39us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664265.370625:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 245 00000100:00100000:2.0:1788664265.370647:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 246 00000100:00100000:2.0:1788664265.370653:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:2393:x1875550119422848:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664265.370683:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:2393:x1875550119422848:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664265.370690:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 246 00000100:00100000:2.0:1788664265.370702:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 247 00000100:00100000:2.0:1788664265.370708:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119423360:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664265.370731:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119423360:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664265.370737:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 247 00000100:00100000:3.0:1788664265.374748:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 244 00000100:00100000:1.0:1788664265.793200:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140483968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664265.793275:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664265.793610:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140483968 00000100:00100000:3.0:1788664265.793619:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140483968 00000100:00100000:3.0:1788664265.793679:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788664265.793688:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140483968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788664265.793721:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788664265.793798:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140483968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664265.793805:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788664265.793814:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140483968:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788664266.178296:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664266.302027:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140484096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664266.302107:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664266.302250:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140484096 00000100:00100000:3.0:1788664266.302259:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140484096 00000100:00100000:3.0:1788664266.302322:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788664266.302333:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140484096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788664266.302362:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664266.302409:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140484096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664266.302416:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:3.0:1788664266.302459:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3040ac700 x1875550140484096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664266.302477:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140484096:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788664266.302627:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664266.308937:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140484224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664266.309026:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664266.309898:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140484224 00000100:00100000:2.0:1788664266.309909:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140484224 00000100:00100000:2.0:1788664266.309975:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788664266.309984:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140484224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664266.310008:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664266.310073:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140484224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664266.310080:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1788664266.310123:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3040ac700 x1875550140484224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664266.310142:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140484224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788664266.310306:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788664266.828255:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788664266.828297:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1788664266.828307:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1788664266.828398:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d91d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828426:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d91d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828434:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d91d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828441:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ce00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664266.828445:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d91d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828453:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d91d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828481:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe41446a2 (ffff93c4130a6100) 00010000:00010000:2.0:1788664266.828485:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664266.828490:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d91d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828496:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413d91d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828531:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d932 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828538:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d932 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828544:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d932 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828549:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664266.828559:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d932 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828566:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d932 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828575:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93c303887300) 00010000:00010000:2.0:1788664266.828578:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664266.828581:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d932 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828586:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413d932 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828607:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413d99b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828613:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413d99b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828619:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413d99b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828623:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ef800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664266.828626:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413d99b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828631:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413d99b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828638:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe41446a2 (ffff93c4130a6100) 00010000:00010000:2.0:1788664266.828640:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664266.828648:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413d99b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828654:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413d99b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828684:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828690:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828695:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828700:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ee200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664266.828703:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828708:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828715:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93c4350d6700) 00010000:00010000:2.0:1788664266.828718:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664266.828720:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9b7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664266.828725:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413d9b7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664266.829292:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788664266.850561:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140484352:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788664266.850637:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664266.851232:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140484352 00000100:00100000:1.0:1788664266.851241:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140484352 00000100:00100000:1.0:1788664266.851314:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788664266.851325:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140484352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788664266.851354:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1788664266.851389:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9cd9c5, atime: 0x6a9cd9c5, ctime: 0x6a9cd9c5, blocks: 0x0 00010000:00010000:1.0:1788664266.851397:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413d9c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664266.851413:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1788664266.851418:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664266.851437:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413d9c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664266.851455:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413d9c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664266.851465:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413d9c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664266.851473:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413d9c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664266.851491:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788664266.851655:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1875550140484352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 331us (1017us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788664266.851662:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788664266.851689:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664266.851695:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413d9c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664266.851703:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84200 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664266.851707:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413d9c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664266.851717:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413d9c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664266.851745:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413d9c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664266.851752:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413d9c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664266.851788:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664266.851791:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664266.851792:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788664266.852347:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788664266.860352:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c3040ad500/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788664266.860368:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140484352:0@lo:6:osp-syn-1-0.0 00000001:02000400:3.0:1788664267.097474:0:13680:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788664267.203183:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664268.224898:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788664268.596029:0:13728:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd756137b0 20000000:00000080:2.0:1788664268.596050:0:13728:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c302b54c00 uarg=0000000000000000 20000000:01000000:2.0:1788664268.596088:0:13728:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788664268.596094:0:13728:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788664268.596099:0:13728:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788664268.600202:0:13729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788664268.600323:0:13728:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788664268.606987:0:13728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788664268.607026:0:13728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788664268.607041:0:13728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788664268.607084:0:13728:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788664268.607102:0:13728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d9cc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.607121:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c303957000/0xcd11f61c1413d852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d214 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.607128:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d859 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d21b expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.607136:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c402a0da00/0xcd11f61c1413d867 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d860 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.607142:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d875 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d86e expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.607148:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c303956c00/0xcd11f61c1413d883 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d87c expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.607154:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c303957600/0xcd11f61c1413d891 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d88a expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.607161:0:13728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d9cc lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.607198:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c303957600/0xcd11f61c1413d891 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d88a expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.607225:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c303957600/0xcd11f61c1413d891 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d88a expref: 23 pid: 6506 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664268.607240:0:13728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875550140484480:0@lo:104: 00000100:00100000:3.0:1788664268.607310:0:13728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664268.607371:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c303956c00/0xcd11f61c1413d883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d87c expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.607379:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c303956c00/0xcd11f61c1413d883 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d87c expref: 23 pid: 6504 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664268.607554:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788664268.607568:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140484480 00000100:00100000:2.0:1788664268.607575:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140484480 00000100:00100000:2.0:1788664268.607621:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788664268.607641:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+3:13728:x1875550140484480:12345-0@lo:104: 00010000:00010000:2.0:1788664268.607654:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d88a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d891 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.607707:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664268.607713:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a681e771-e9ab-478d-af58-39fce2e20de6+3:13728:x1875550140484480:12345-0@lo:104: Request processed in 75us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664268.607721:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1788664268.607791:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664268.607799:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d88a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d891 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664268.607806:0:13728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875550140484608:0@lo:104: 00010000:00010000:2.0:1788664268.607810:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ef000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664268.607826:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d88a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d891 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.607835:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d88a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d891 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664268.607843:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d88a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d891 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664268.607850:0:13728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788664268.607861:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788664268.607893:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d86e expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.607896:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d88a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d891 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.607910:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788664268.607913:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d875 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d86e expref: 23 pid: 6504 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664268.607926:0:13728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875550140484736:0@lo:104: 00010000:00010000:2.0:1788664268.607931:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d88a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d891 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.607939:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4351ef000/0xcd11f61c1413d88a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d891 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664268.607952:0:13728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664268.607953:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664268.607957:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664268.607959:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664268.607970:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664268.607990:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140484864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788664268.607993:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c402a0da00/0xcd11f61c1413d867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413d860 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.608005:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c402a0da00/0xcd11f61c1413d867 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413d860 expref: 23 pid: 6504 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664268.608014:0:13728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875550140484992:0@lo:104: 00000100:00100000:2.0:1788664268.608026:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664268.608056:0:13728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664268.608062:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140484864 00000100:00100000:2.0:1788664268.608067:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140484864 00010000:00010000:3.0:1788664268.608084:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d21b expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.608090:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c303957600/0xcd11f61c1413d891 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d88a expref: 24 pid: 6506 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.608103:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d859 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d21b expref: 12 pid: 6504 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664268.608117:0:13728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040adc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875550140485120:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664268.608121:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788664268.608132:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140484864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664268.608143:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664268.608149:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c303957600/0xcd11f61c1413d891 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d88a expref: 24 pid: 6506 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.608160:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c303957600/0xcd11f61c1413d891 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d88a expref: 24 pid: 6506 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.608184:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664268.608188:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c303957000/0xcd11f61c1413d852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d214 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.608201:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c303957000/0xcd11f61c1413d852 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d214 expref: 12 pid: 6506 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664268.608213:0:13728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875550140485248:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664268.608220:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140484864:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664268.608228:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788664268.608242:0:13728:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412f70180 going to sleep for 11 seconds 00000100:00100000:2.0:1788664268.608254:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140484608 00000100:00100000:2.0:1788664268.608259:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140484608 00010000:00010000:3.0:1788664268.608267:0:13728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303957600/0xcd11f61c1413d891 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d88a expref: 23 pid: 6506 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664268.608276:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140484736 00000100:00100000:3.0:1788664268.608280:0:13728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875550140484480:0@lo:104: 00000100:00100000:2.0:1788664268.608280:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140484736 00000100:00100000:2.0:1788664268.608298:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140484992 00000100:00100000:2.0:1788664268.608301:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140484992 00000100:00100000:2.0:1788664268.608314:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788664268.608322:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+5:13728:x1875550140484608:12345-0@lo:104: 00000100:00100000:3.0:1788664268.608323:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788664268.608335:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1788664268.608336:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c303957e00/0xcd11f61c1413d87c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d883 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.610738:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664268.610753:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+5:13728:x1875550140484608:12345-0@lo:104: Request processed in 2429us (2900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664268.610765:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788664268.610832:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788664268.610958:0:13730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788664268.610970:0:13730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a681e771-e9ab-478d-af58-39fce2e20de6+4:13728:x1875550140484992:12345-0@lo:104: 00000100:00100000:2.0:1788664268.610976:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+4:13728:x1875550140484736:12345-0@lo:104: 00010000:00010000:1.0:1788664268.610997:0:13730:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d860 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d867 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.611064:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413d86e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d875 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664268.614645:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140484864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788664268.614737:0:13728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875550140484608:0@lo:104: 00000100:00100000:3.0:1788664268.614747:0:13728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875550140484736:0@lo:104: 00000100:00100000:3.0:1788664268.614755:0:13728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875550140484992:0@lo:104: 00010000:00010000:1.0:1788664268.614914:0:13730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788664268.614926:0:13730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a681e771-e9ab-478d-af58-39fce2e20de6+4:13728:x1875550140484992:12345-0@lo:104: Request processed in 3957us (6867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664268.614937:0:13730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1788664268.615567:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788664268.615577:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a681e771-e9ab-478d-af58-39fce2e20de6+3:13728:x1875550140484736:12345-0@lo:104: Request processed in 4735us (7623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664268.615604:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1788664268.615699:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788664268.615707:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c303957e00/0xcd11f61c1413d87c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d883 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.615719:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957e00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664268.615724:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c303957e00/0xcd11f61c1413d87c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d883 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.615736:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c303957e00/0xcd11f61c1413d87c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d883 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664268.615744:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c303957e00/0xcd11f61c1413d87c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d883 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664268.615751:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788664268.615823:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c303957e00/0xcd11f61c1413d87c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d883 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.615830:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664268.615854:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c303957e00/0xcd11f61c1413d87c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d883 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.615862:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c303957e00/0xcd11f61c1413d87c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d883 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.615877:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788664268.615881:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d860 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d867 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.615898:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ee600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664268.615901:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d860 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d867 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.615908:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d860 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d867 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664268.615915:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d860 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d867 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664268.615920:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788664268.616309:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d860 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d867 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.616317:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664268.616324:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d860 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d867 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.616330:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4351ee600/0xcd11f61c1413d860 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d867 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.616341:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664268.616345:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413d86e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413d875 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.616351:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84e00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664268.616354:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413d86e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413d875 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.616372:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413d86e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413d875 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664268.616378:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413d86e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413d875 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664268.616383:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788664268.616396:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413d86e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d875 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.616401:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664268.616418:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413d86e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d875 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.616425:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413d86e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413d875 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.616440:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664268.616446:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664268.616448:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664268.616464:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140485376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664268.616525:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664268.616563:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664268.616571:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140485504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664268.616594:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664268.616704:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664268.616713:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140485632:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788664268.616865:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664268.616869:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140485376 00000100:00100000:0.0:1788664268.616877:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140485376 00010000:00010000:0.0:1788664268.616908:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c303956c00/0xcd11f61c1413d883 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d87c expref: 23 pid: 6504 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664268.616943:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140485504 00000100:00100000:0.0:1788664268.616954:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140485504 00010000:00010000:0.0:1788664268.616983:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c402a0da00/0xcd11f61c1413d867 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d860 expref: 24 pid: 6504 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664268.617011:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788664268.617020:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140485376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788664268.617025:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664268.617035:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664268.617042:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c303956c00/0xcd11f61c1413d883 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d87c expref: 24 pid: 6504 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664268.617054:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c303956c00/0xcd11f61c1413d883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d87c expref: 24 pid: 6504 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664268.617056:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788664268.617065:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140485504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788664268.617073:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664268.617079:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c402a0da00/0xcd11f61c1413d867 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d860 expref: 24 pid: 6504 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664268.617134:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303956c00/0xcd11f61c1413d883 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d87c expref: 24 pid: 6504 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664268.617472:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664268.619390:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140485632 00000100:00100000:1.0:1788664268.619405:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140485632 00010000:00010000:1.0:1788664268.619448:0:10332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d875 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d86e expref: 24 pid: 6504 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664268.619494:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788664268.619503:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140485632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788664268.619519:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664268.619525:0:10332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d875 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413d86e expref: 24 pid: 6504 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.621004:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c402a0da00/0xcd11f61c1413d867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d860 expref: 24 pid: 6504 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.621034:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0da00/0xcd11f61c1413d867 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d860 expref: 24 pid: 6504 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.621052:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664268.621155:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+23:3636:x1875550140485504:12345-0@lo:103:ldlm_bl.0 Request processed in 4090us (4558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664268.621165:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788664268.621203:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140485504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664268.621369:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664268.621408:0:10332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413d86e expref: 22 pid: 6504 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664268.621417:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a681e771-e9ab-478d-af58-39fce2e20de6+22:3636:x1875550140485376:12345-0@lo:103:ldlm_bl.0 Request processed in 4396us (4889us total) trans 0 rc 0/0 00010000:00010000:1.0:1788664268.621425:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413d875 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413d86e expref: 22 pid: 6504 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664268.621428:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1788664268.621442:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664268.621491:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a681e771-e9ab-478d-af58-39fce2e20de6+20:3639:x1875550140485632:12345-0@lo:103:ldlm_bl.0 Request processed in 1989us (4019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664268.621498:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788664268.621560:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140485376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788664268.621617:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140485632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788664268.624508:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664268.624570:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119423488 00000100:00100000:2.0:1788664268.624580:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119423488 00010000:00010000:2.0:1788664268.624618:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c303957000/0xcd11f61c1413d852 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d214 expref: 13 pid: 6506 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664268.624651:0:13728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875550140485248:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664268.624673:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:2.0:1788664268.624684:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119423488:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664268.624700:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664268.624707:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c303957000/0xcd11f61c1413d852 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d214 expref: 13 pid: 6506 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.624718:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c303957000/0xcd11f61c1413d852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d214 expref: 13 pid: 6506 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.624737:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303957000/0xcd11f61c1413d852 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d214 expref: 13 pid: 6506 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664268.624752:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664268.624893:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:2390:x1875550119423488:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 210us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664268.624901:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:3.0:1788664268.625120:0:13728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040adc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875550140485120:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664268.625166:0:13728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d9cc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664268.628885:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664268.629158:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119423616 00000100:00100000:3.0:1788664268.629169:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119423616 00010000:00010000:3.0:1788664268.629208:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d859 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d21b expref: 12 pid: 6504 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664268.629251:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:3.0:1788664268.629287:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:2390:x1875550119423616:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664268.629306:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664268.629312:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d859 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d21b expref: 12 pid: 6504 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.629325:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d21b expref: 12 pid: 6504 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.629343:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413d859 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d21b expref: 12 pid: 6504 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.629362:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d9cc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.629370:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d9cc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.629399:0:8443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d9cc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.629407:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d9cc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.629413:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d9cc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.629420:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d9cc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.629426:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ee400 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664268.629431:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d9cc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.629445:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d9cc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.629471:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d9cc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664268.629482:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664268.629551:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:2390:x1875550119423616:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 277us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664268.629560:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00010000:00010000:1.0:1788664268.629738:0:13728:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d9cc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664268.629747:0:13728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d9cc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664268.629755:0:13728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4351ee400/0xcd11f61c1413d9cc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664269.249263:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664269.374953:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664269.374990:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140485760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664269.375089:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664269.377670:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140485760 00000100:00100000:3.0:1788664269.377697:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140485760 00000100:00100000:3.0:1788664269.377791:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788664269.377804:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140485760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664269.377869:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788664269.377991:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140485760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 189us (2902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664269.377998:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788664269.378403:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140485760:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1788664269.751581:0:13778:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb4f73480 20000000:00000080:3.0:1788664269.751602:0:13778:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c303bd2c00 uarg=0000000000000000 20000000:01000000:3.0:1788664269.751644:0:13778:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788664269.751651:0:13778:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788664269.751655:0:13778:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1788664269.757916:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1788664269.758201:0:13778:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1788664269.758313:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1788664269.758342:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1788664269.758359:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1788664269.758372:0:13778:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788664269.758393:0:13778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c303b85000/0xcd11f61c1413d9d3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664269.758419:0:13778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303b85000/0xcd11f61c1413d9d3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664269.758430:0:13778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c303b85000/0xcd11f61c1413d9d3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664269.758436:0:13778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c303b85000/0xcd11f61c1413d9d3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664269.758444:0:13778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c303b85000/0xcd11f61c1413d9d3 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664269.758452:0:13778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c303b85000/0xcd11f61c1413d9d3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664269.758459:0:13778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85000 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664269.758463:0:13778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c303b85000/0xcd11f61c1413d9d3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664269.758470:0:13778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c303b85000/0xcd11f61c1413d9d3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664269.758482:0:13778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c303b85000/0xcd11f61c1413d9d3 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664269.758491:0:13778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c303b85000/0xcd11f61c1413d9d3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664269.758504:0:13778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303b85000/0xcd11f61c1413d9d3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664269.888165:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140485888:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.888245:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664269.888297:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140486400:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.888326:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664269.888348:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140486912:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.888373:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664269.888391:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140487424:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.888413:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664269.888438:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788664269.888444:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140486016:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.888470:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664269.888486:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140486528:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.888508:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664269.888524:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140487040:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.888545:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664269.888576:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140486144:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.888600:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664269.888618:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140486656:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.888640:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664269.888654:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140487168:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.888675:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664269.888694:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788664269.888700:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140486272:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.888721:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664269.888744:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140486784:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.888768:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664269.888823:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140487296:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.888846:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664269.888876:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140486400 00000100:00100000:2.0:1788664269.888883:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140486400 00000100:00100000:2.0:1788664269.888926:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140486144 00000100:00100000:2.0:1788664269.888930:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140486144 00000100:00100000:2.0:1788664269.888947:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788664269.888955:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140486400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.889007:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140486400:12345-0@lo:400:kworker.0 Request processed in 52us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.889014:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788664269.889031:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788664269.889037:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140486144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.889069:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140486144:12345-0@lo:400:kworker.0 Request processed in 32us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.889074:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788664269.889093:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140486912 00000100:00100000:2.0:1788664269.889096:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140486912 00000100:00100000:2.0:1788664269.889124:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140487424 00000100:00100000:2.0:1788664269.889127:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140487424 00000100:00100000:2.0:1788664269.889140:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140486784 00000100:00100000:2.0:1788664269.889142:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140486784 00000100:00100000:2.0:1788664269.889154:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140487296 00000100:00100000:2.0:1788664269.889156:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140487296 00000100:00100000:2.0:1788664269.889170:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788664269.889176:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140486912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.889218:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140486912:12345-0@lo:400:kworker.0 Request processed in 42us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.889224:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788664269.889236:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788664269.889242:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1875550140487424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.889268:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1875550140487424:12345-0@lo:400:kworker.0 Request processed in 26us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.889274:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788664269.889284:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788664269.889290:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140486784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.889318:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140486784:12345-0@lo:400:kworker.0 Request processed in 28us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.889324:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788664269.889335:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788664269.889341:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140487296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.889368:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140487296:12345-0@lo:400:kworker.0 Request processed in 28us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.889374:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788664269.889398:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140486016 00000100:00100000:2.0:1788664269.889401:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140486016 00000100:00100000:2.0:1788664269.889419:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140486528 00000100:00100000:2.0:1788664269.889421:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140486528 00000100:00100000:2.0:1788664269.889433:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140487040 00000100:00100000:2.0:1788664269.889435:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140487040 00000100:00100000:2.0:1788664269.889445:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140486656 00000100:00100000:2.0:1788664269.889448:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140486656 00000100:00100000:2.0:1788664269.889457:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140487168 00000100:00100000:2.0:1788664269.889465:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140487168 00000100:00100000:2.0:1788664269.889481:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140486272 00000100:00100000:2.0:1788664269.889483:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140486272 00000100:00100000:2.0:1788664269.889497:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788664269.889502:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140486016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.889533:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140486016:12345-0@lo:400:kworker.0 Request processed in 31us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.889539:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788664269.889550:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788664269.889555:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140486528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.889579:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140486528:12345-0@lo:400:kworker.0 Request processed in 24us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.889585:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788664269.889595:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788664269.889600:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140487040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.889625:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140487040:12345-0@lo:400:kworker.0 Request processed in 24us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.889630:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788664269.889641:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788664269.889647:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140486656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.889674:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140486656:12345-0@lo:400:kworker.0 Request processed in 27us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.889679:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788664269.889690:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788664269.889696:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140487168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.889722:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140487168:12345-0@lo:400:kworker.0 Request processed in 27us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.889734:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788664269.889747:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788664269.889753:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140486272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.889820:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140486272:12345-0@lo:400:kworker.0 Request processed in 66us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.889825:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00080000:2.0:1788664269.889868:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788664269.889872:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664269.889875:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664269.889877:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664269.889906:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140486272:0@lo:400:kworker.0 00010000:00080000:2.0:1788664269.889920:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b9fb80 x1875550140486784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664269.889930:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140486784:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.889940:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140487296:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.889948:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140486144:0@lo:400:kworker.0 00010000:00080000:2.0:1788664269.889957:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b9c700 x1875550140486656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664269.889965:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140486656:0@lo:400:kworker.0 00010000:00080000:2.0:1788664269.889974:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b71c00 x1875550140487168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664269.889982:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140487168:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.890023:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140486016:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.890043:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140486528:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.890053:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140487040:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.890062:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140486400:0@lo:400:kworker.0 00010000:00080000:2.0:1788664269.890073:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b72a00 x1875550140486912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664269.890081:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140486912:0@lo:400:kworker.0 00000100:00100000:2.0:1788664269.890093:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140487424:0@lo:400:kworker.0 00000100:00100000:3.0:1788664269.890180:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140485888 00000100:00100000:3.0:1788664269.890185:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140485888 00000100:00100000:3.0:1788664269.890226:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788664269.890233:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+20:3636:x1875550140485888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664269.890283:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+20:3636:x1875550140485888:12345-0@lo:400:kworker.0 Request processed in 51us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664269.890289:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788664269.890329:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140485888:0@lo:400:kworker.0 00000100:00100000:0.0:1788664269.891971:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664269.891991:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140487552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664269.892072:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664269.892192:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140487552 00000100:00100000:2.0:1788664269.892199:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140487552 00000100:00100000:2.0:1788664269.892246:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788664269.892256:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875550140487552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664269.892294:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664269.892868:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875550140487552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 612us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.892877:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788664269.899035:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140487552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664269.911864:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664269.914958:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119423744 00000100:00100000:1.0:1788664269.914973:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119423744 00000100:00100000:1.0:1788664269.915031:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 344 00000100:00100000:1.0:1788664269.915040:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:6163:x1875550119423744:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664269.915057:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664269.915078:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303b85400/0xcd11f61c1413d9da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d268 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664269.915105:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303b85400/0xcd11f61c1413d9da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d268 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664269.915117:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303b85400/0xcd11f61c1413d9da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d268 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664269.915125:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85400, rc 0) 00000100:00100000:1.0:1788664269.915179:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:6163:x1875550119423744:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 141us (3329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664269.915186:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 344 00000100:00100000:3.0:1788664269.923239:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664269.923342:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119423872 00000100:00100000:2.0:1788664269.923353:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119423872 00000100:00100000:2.0:1788664269.923418:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 345 00000100:00100000:2.0:1788664269.923429:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:6163:x1875550119423872:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664269.923573:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:6163:x1875550119423872:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 146us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.923581:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 345 00000100:00100000:0.0:1788664269.937237:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664269.937394:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119424000 00000100:00100000:1.0:1788664269.937414:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119424000 00000100:00100000:1.0:1788664269.937476:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 346 00000100:00100000:1.0:1788664269.937487:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:6163:x1875550119424000:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664269.937634:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:6163:x1875550119424000:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 147us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664269.937648:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 346 00000100:00100000:3.0:1788664269.941396:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664269.941488:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119424128 00000100:00100000:0.0:1788664269.941498:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119424128 00000100:00100000:0.0:1788664269.941555:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 347 00000100:00100000:0.0:1788664269.941566:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:10767:x1875550119424128:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788664269.941732:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:10767:x1875550119424128:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 167us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664269.941740:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 347 00000100:00100000:1.0:1788664269.955019:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664269.955087:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119424256 00000100:00100000:3.0:1788664269.955098:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119424256 00000100:00100000:3.0:1788664269.955151:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 348 00000100:00100000:3.0:1788664269.955161:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:10767:x1875550119424256:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788664269.955313:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:10767:x1875550119424256:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 152us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664269.955321:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 348 00000100:00100000:2.0:1788664269.975681:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664269.977534:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119424384 00000100:00100000:0.0:1788664269.977549:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119424384 00000100:00100000:0.0:1788664269.977615:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 349 00000100:00100000:0.0:1788664269.977624:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:6163:x1875550119424384:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664269.977640:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664269.977656:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303956e00/0xcd11f61c1413d9e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d26f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664269.977686:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303956e00/0xcd11f61c1413d9e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d26f expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664269.977697:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303956e00/0xcd11f61c1413d9e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d26f expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664269.977706:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956e00, rc 0) 00000100:00100000:0.0:1788664269.977761:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:6163:x1875550119424384:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 138us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664269.977767:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 349 00000100:00100000:2.0:1788664269.981899:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664269.981938:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119424512 00000100:00100000:2.0:1788664269.981948:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119424512 00000100:00100000:2.0:1788664269.981994:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 350 00000100:00100000:2.0:1788664269.982002:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:6163:x1875550119424512:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664269.982150:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:6163:x1875550119424512:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 147us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.982157:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 350 00000100:00100000:0.0:1788664269.995615:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664269.995650:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119424640 00000100:00100000:0.0:1788664269.995661:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119424640 00000100:00100000:0.0:1788664269.995707:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 351 00000100:00100000:0.0:1788664269.995716:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:6163:x1875550119424640:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664269.995896:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:6163:x1875550119424640:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 177us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664269.995904:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 351 00000100:00100000:1.0:1788664270.013748:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664270.014524:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119424768 00000100:00100000:0.0:1788664270.014534:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119424768 00000100:00100000:0.0:1788664270.014589:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 352 00000100:00100000:0.0:1788664270.014599:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:10771:x1875550119424768:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788664270.014755:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:10771:x1875550119424768:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 158us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664270.014764:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 352 10000000:01000000:1.0:1788664270.015373:0:6508:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788664270.015377:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c302578800 from 7 10000000:01000000:1.0:1788664270.015381:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664270.015538:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664270.015550:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664270.015560:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664270.015583:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140487680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788664270.015630:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664270.015677:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3027a9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664270.015726:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140487680 00000100:00100000:0.0:1788664270.015731:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140487680 00000100:00100000:0.0:1788664270.015767:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788664270.015797:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+20:6508:x1875550140487680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664270.015816:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664270.015830:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303956a00/0xcd11f61c1413d9ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d9e8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664270.015852:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303956a00/0xcd11f61c1413d9ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d9e8 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664270.015862:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303956a00/0xcd11f61c1413d9ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d9e8 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664270.015870:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956a00, rc 0) 00000100:00100000:0.0:1788664270.015907:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140487680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664270.015925:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788664270.015965:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140487680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664270.015979:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d9ef expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664270.015989:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d9ef expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664270.016042:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140487808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664270.016074:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664270.016093:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c418280240 going to sleep for 11 seconds 00000100:00100000:1.0:1788664270.016235:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140487808 00000100:00100000:1.0:1788664270.016241:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140487808 00000100:00100000:1.0:1788664270.016272:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788664270.016278:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140487808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664270.016434:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140487808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664270.016440:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788664270.016606:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140487808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664270.016650:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140487936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664270.016697:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664270.016721:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c418280240 going to sleep for 11 seconds 00000100:00100000:1.0:1788664270.017205:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140487936 00000100:00100000:1.0:1788664270.017211:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140487936 00000100:00100000:1.0:1788664270.017239:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788664270.017254:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140487936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664270.017336:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140487936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664270.017343:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788664270.017581:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140487936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664270.018321:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664270.018366:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119424896 00000100:00100000:3.0:1788664270.018371:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119424896 00000100:00100000:3.0:1788664270.019495:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 356 00000100:00100000:3.0:1788664270.019508:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:10771:x1875550119424896:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788664270.019631:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:10771:x1875550119424896:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 125us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664270.019638:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 356 00000100:00100000:0.0:1788664270.026719:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13791:1875550140488064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664270.026842:0:13791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664270.026879:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c418280600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664270.026962:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140488064 00000100:00100000:3.0:1788664270.026970:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140488064 00000100:00100000:3.0:1788664270.027027:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788664270.027036:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+21:13791:x1875550140488064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664270.027164:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+21:13791:x1875550140488064:12345-0@lo:502:llog_process_th.0 Request processed in 128us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664270.027172:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788664270.027262:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13791:1875550140488064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788664270.027291:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788664270.027302:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664270.027304:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788664270.027310:0:13791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c302578800 00000020:00000080:0.0:1788664270.027319:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788664270.027388:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664270.027391:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664270.027393:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788664270.027396:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788664270.027398:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664270.027513:0:13791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788664270.027522:0:13791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c302578800 00000020:00000080:0.0:1788664270.027524:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788664270.027563:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13791:1875550140488192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664270.027600:0:13791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664270.027615:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c418280600 going to sleep for 11 seconds 00000100:00100000:1.0:1788664270.027663:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140488192 00000100:00100000:1.0:1788664270.027668:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140488192 00000100:00100000:1.0:1788664270.027704:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788664270.027713:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:13791:x1875550140488192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664270.027816:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:13791:x1875550140488192:12345-0@lo:502:llog_process_th.0 Request processed in 94us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664270.027823:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788664270.027909:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13791:1875550140488192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788664270.027928:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664270.027933:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664270.027934:0:13791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788664270.027937:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788664270.028491:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788664270.028514:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788664270.028523:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d9ef expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664270.028536:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d9ef expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664270.028547:0:6508:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788664270.028549:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c42f78b000 from 7 10000000:01000000:1.0:1788664270.028552:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664270.028577:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664270.028585:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664270.028595:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664270.028619:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140488320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788664270.028661:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664270.028679:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403067000 going to sleep for 11 seconds 00000100:00100000:1.0:1788664270.028692:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140488320 00000100:00100000:1.0:1788664270.028696:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140488320 00000100:00100000:1.0:1788664270.028723:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788664270.028729:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c420ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+21:6508:x1875550140488320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664270.028739:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664270.028749:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303b84400/0xcd11f61c1413d9fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413d9f6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664270.028792:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303b84400/0xcd11f61c1413d9fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413d9f6 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664270.028802:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303b84400/0xcd11f61c1413d9fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413d9f6 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664270.028819:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b84400, rc 0) 00000100:00100000:1.0:1788664270.028852:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c420ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140488320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664270.028859:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788664270.028892:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140488320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664270.028905:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d9fd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664270.028913:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d9fd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664270.028965:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140488448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664270.028994:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664270.029023:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403067000 going to sleep for 11 seconds 00000100:00100000:2.0:1788664270.029130:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140488448 00000100:00100000:2.0:1788664270.029134:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140488448 00000100:00100000:2.0:1788664270.029164:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788664270.029170:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c410474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140488448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664270.029267:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c410474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140488448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664270.029273:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788664270.029302:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140488448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664270.029330:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140488576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664270.029502:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664270.029525:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412f70180 going to sleep for 11 seconds 00000100:00100000:2.0:1788664270.030177:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140488576 00000100:00100000:2.0:1788664270.030184:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140488576 00000100:00100000:2.0:1788664270.030225:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788664270.030233:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c410475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140488576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664270.030326:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c410475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140488576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664270.030341:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788664270.030399:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140488576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664270.030655:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13792:1875550140488704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664270.030692:0:13792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664270.030713:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140488704 00000100:00100000:2.0:1788664270.030716:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140488704 00000100:00100000:2.0:1788664270.030734:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788664270.030740:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c421997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:13792:x1875550140488704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664270.030849:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c421997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:13792:x1875550140488704:12345-0@lo:502:llog_process_th.0 Request processed in 108us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664270.030856:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788664270.030891:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c40820cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664270.030903:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13792:1875550140488704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664270.030922:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664270.030931:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664270.030934:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788664270.030940:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c42f78b000 00000020:00000080:2.0:1788664270.030943:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788664270.030986:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664270.030989:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664270.030990:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788664270.030992:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664270.030994:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664270.030996:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788664270.030999:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c42f78b000 00000020:00000080:2.0:1788664270.031001:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788664270.031036:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13792:1875550140488832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664270.032187:0:13792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664270.032223:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c40820cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664270.032504:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140488832 00000100:00100000:1.0:1788664270.032512:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140488832 00000100:00100000:1.0:1788664270.032557:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788664270.032566:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:13792:x1875550140488832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664270.032678:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+22:13792:x1875550140488832:12345-0@lo:502:llog_process_th.0 Request processed in 113us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664270.032686:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788664270.032701:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13792:1875550140488832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664270.032727:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664270.032734:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664270.032737:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788664270.032741:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788664270.033489:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788664270.033513:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788664270.033523:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d9fd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664270.033535:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d9fd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664270.033546:0:6508:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788664270.033549:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c42d99f800 from 7 10000000:01000000:1.0:1788664270.033552:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664270.033582:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664270.033591:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664270.033600:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664270.033628:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140488960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788664270.033677:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664270.033714:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4126d1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788664270.033820:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140488960 00000100:00100000:2.0:1788664270.033825:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140488960 00000100:00100000:2.0:1788664270.033866:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788664270.033874:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+22:6508:x1875550140488960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664270.033885:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664270.033896:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413da0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413da04 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664270.033917:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413da0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413da04 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664270.033928:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413da0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413da04 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664270.033936:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d000, rc 0) 00000100:00100000:2.0:1788664270.033979:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140488960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664270.033985:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788664270.034394:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140488960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664270.034417:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413da0b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664270.034426:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413da0b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664270.034479:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140489088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664270.034509:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664270.034538:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4126d1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788664270.034552:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140489088 00000100:00100000:2.0:1788664270.034557:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140489088 00000100:00100000:2.0:1788664270.034590:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788664270.034604:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140489088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664270.034707:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140489088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664270.034714:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788664270.034744:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140489088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664270.034793:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140489216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664270.034842:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664270.034860:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4011ca540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664270.034872:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140489216 00000100:00100000:2.0:1788664270.034876:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140489216 00000100:00100000:2.0:1788664270.034897:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788664270.034903:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140489216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664270.034986:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140489216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664270.034993:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788664270.035032:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140489216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664270.040292:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13794:1875550140489344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664270.040377:0:13794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664270.040425:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f764780 going to sleep for 11 seconds 00000100:00100000:0.0:1788664270.040516:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140489344 00000100:00100000:0.0:1788664270.040523:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140489344 00000100:00100000:0.0:1788664270.040574:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788664270.040585:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+23:13794:x1875550140489344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664270.040715:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+23:13794:x1875550140489344:12345-0@lo:502:llog_process_th.0 Request processed in 132us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664270.040723:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788664270.041503:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13794:1875550140489344:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664270.041538:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664270.041548:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664270.041551:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788664270.041558:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c42d99f800 00000020:00000080:2.0:1788664270.041567:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788664270.041630:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664270.041634:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664270.041635:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788664270.041638:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664270.041641:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664270.041642:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788664270.041646:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c42d99f800 00000020:00000080:2.0:1788664270.041648:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788664270.041684:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13794:1875550140489472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664270.041732:0:13794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664270.041766:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f764780 going to sleep for 11 seconds 00000100:00100000:1.0:1788664270.042821:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140489472 00000100:00100000:1.0:1788664270.042831:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140489472 00000100:00100000:1.0:1788664270.042877:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788664270.042886:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+23:13794:x1875550140489472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664270.043029:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+23:13794:x1875550140489472:12345-0@lo:502:llog_process_th.0 Request processed in 144us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664270.043037:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788664270.043514:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13794:1875550140489472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788664270.043547:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664270.043555:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664270.043557:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788664270.043566:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788664270.045593:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788664270.045647:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788664270.045659:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413da0b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664270.045672:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413da0b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664270.045683:0:6508:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:3.0:1788664270.045685:0:6508:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c40641a800 from 7 10000000:01000000:3.0:1788664270.045689:0:6508:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788664270.045723:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664270.045731:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664270.045740:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664270.045765:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140489600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664270.045881:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664270.045921:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6480 going to sleep for 11 seconds 00000100:00100000:2.0:1788664270.046286:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140489600 00000100:00100000:2.0:1788664270.046294:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140489600 00000100:00100000:2.0:1788664270.046376:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788664270.046389:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+23:6508:x1875550140489600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664270.046403:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664270.046512:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413da19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413da12 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664270.046538:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413da19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413da12 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664270.046549:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413da19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413da12 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664270.046558:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d400, rc 0) 00000100:00100000:2.0:1788664270.046610:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140489600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664270.046662:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140489600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664270.046683:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413da19 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664270.046692:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413da19 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664270.046750:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140489728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664270.046797:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664270.046831:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6480 going to sleep for 11 seconds 00000100:00100000:1.0:1788664270.049862:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140489728 00000100:00100000:1.0:1788664270.049876:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140489728 00000100:00100000:2.0:1788664270.051749:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000040:00080000:0.0:1788664270.052924:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788664270.057342:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788664270.057370:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140489728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664270.057564:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140489728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (10765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664270.057584:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788664270.058594:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140489728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664270.058651:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140489856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664270.058713:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664270.058756:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6480 going to sleep for 11 seconds 00000100:00100000:2.0:1788664270.058760:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140489856 00000100:00100000:2.0:1788664270.058767:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140489856 00000100:00100000:2.0:1788664270.058866:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788664270.058875:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140489856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664270.058977:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:6508:x1875550140489856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664270.058984:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1788664270.059239:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a681e771-e9ab-478d-af58-39fce2e20de6:6508:1875550140489856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664270.059760:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13797:1875550140489984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664270.059849:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664270.059877:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f764000 going to sleep for 11 seconds 00000100:00100000:1.0:1788664270.059930:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140489984 00000100:00100000:1.0:1788664270.059935:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140489984 00000100:00100000:1.0:1788664270.059974:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788664270.059984:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:13797:x1875550140489984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664270.060088:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:13797:x1875550140489984:12345-0@lo:502:llog_process_th.0 Request processed in 104us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664270.060095:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788664270.060146:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13797:1875550140489984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664270.060172:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664270.060183:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664270.060185:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788664270.060191:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c40641a800 00000020:00000080:3.0:1788664270.060193:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788664270.060259:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664270.060263:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664270.060265:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788664270.060268:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664270.060270:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664270.060271:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788664270.060275:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c40641a800 00000020:00000080:3.0:1788664270.060277:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788664270.060309:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13797:1875550140490112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664270.060346:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664270.060379:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664270.060517:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140490112 00000100:00100000:2.0:1788664270.060522:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140490112 00000100:00100000:2.0:1788664270.060556:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788664270.060564:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:13797:x1875550140490112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664270.060633:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:13797:x1875550140490112:12345-0@lo:502:llog_process_th.0 Request processed in 69us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664270.060649:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788664270.061522:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a681e771-e9ab-478d-af58-39fce2e20de6:13797:1875550140490112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664270.061554:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664270.061562:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664270.061564:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788664270.061568:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788664270.062867:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788664270.062900:0:6508:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788664270.062911:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413da19 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664270.062923:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413da19 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788664270.076246:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788664270.275416:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664270.400977:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140490240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664270.401048:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664270.401190:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140490240 00000100:00100000:1.0:1788664270.401198:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140490240 00000100:00100000:1.0:1788664270.401254:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788664270.401265:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140490240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788664270.401287:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664270.401343:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140490240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664270.401350:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788664270.401869:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140490240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664270.486409:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664270.486450:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664270.486544:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119425024 00000100:00100000:2.0:1788664270.486555:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119425024 00000100:00100000:2.0:1788664270.486614:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 374 00000100:00100000:2.0:1788664270.486625:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2393:x1875550119425024:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664270.486695:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2393:x1875550119425024:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 72us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664270.486703:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 374 00000100:00100000:0.0:1788664270.487163:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664270.487735:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664270.487819:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119425280 00000100:00100000:3.0:1788664270.487827:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119425280 00000100:00100000:3.0:1788664270.487886:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119425536 00000100:00100000:3.0:1788664270.487889:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119425536 00000100:00100000:3.0:1788664270.487911:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 254 00000100:00100000:3.0:1788664270.487919:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119425280:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664270.487975:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119425280:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 56us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664270.487982:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 254 00000100:00100000:3.0:1788664270.487998:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 255 00000100:00100000:3.0:1788664270.488005:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119425536:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664270.488044:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119425536:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 40us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664270.488050:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 255 00000100:00080000:1.0:1788664270.488144:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788664270.488161:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788664270.492980:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664270.493061:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664270.493111:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119425408 00000100:00100000:1.0:1788664270.493122:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119425408 00000100:00100000:1.0:1788664270.493190:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:1.0:1788664270.493215:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119425408:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664270.493294:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119425408:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 82us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664270.493302:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00080000:1.0:1788664270.493324:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664270.498959:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119425152 00000100:00100000:3.0:1788664270.501572:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119425664 00000100:00100000:3.0:1788664270.501585:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119425664 00000100:00100000:3.0:1788664270.501684:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 256 00000100:00100000:3.0:1788664270.501693:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119425664:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664270.501817:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119425664:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 123us (8764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664270.501825:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 256 00000100:00080000:0.0:1788664270.502053:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664270.504205:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119425152 00000100:00100000:2.0:1788664270.504298:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 257 00000100:00100000:2.0:1788664270.504308:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119425152:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:0.0:1788664270.504460:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664270.504633:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119425152:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 325us (16897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664270.504642:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 257 00000100:00100000:0.0:1788664270.911679:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664270.915553:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140490368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788664270.915634:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664270.919812:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140490368 00000100:00100000:1.0:1788664270.919830:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140490368 00000100:00100000:1.0:1788664270.919901:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788664270.919913:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140490368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664270.919954:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788664270.920053:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140490368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (4418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664270.920061:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788664270.920677:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140490368:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788664271.102487:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788664271.103305:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788664271.294391:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664271.422034:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140490496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664271.422134:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664271.422208:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664271.422219:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140490624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664271.422247:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664271.422266:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140490496 00000100:00100000:1.0:1788664271.422274:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140490496 00000100:00100000:1.0:1788664271.422338:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140490624 00000100:00100000:1.0:1788664271.422351:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140490624 00000100:00100000:1.0:1788664271.422372:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788664271.422379:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140490496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788664271.422409:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664271.422455:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140490496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664271.422479:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788664271.422495:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788664271.422500:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140490624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664271.422510:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664271.422535:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140490624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664271.422541:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1788664271.422741:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788664271.422790:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b72680 x1875550140490624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664271.422881:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140490624:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788664271.422904:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b71f80 x1875550140490496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664271.422915:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140490496:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788664272.318010:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788664272.960861:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:3.0:1788664273.348438:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664274.365948:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664274.494803:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664274.494828:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140490752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664274.494899:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664274.495082:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140490752 00000100:00100000:2.0:1788664274.495091:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140490752 00000100:00100000:2.0:1788664274.495150:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788664274.495161:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140490752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788664274.495200:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788664274.495261:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140490752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664274.495269:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788664274.495362:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140490752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664275.007301:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140490880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664275.007374:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664275.007839:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140490880 00000100:00100000:3.0:1788664275.007848:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140490880 00000100:00100000:3.0:1788664275.007918:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788664275.007928:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140490880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664275.007962:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664275.008017:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140490880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664275.008033:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788664275.008073:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788664275.008079:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c3040ad500, transno 4294967301 00000100:00100000:3.0:1788664275.008096:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140490880:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788664275.008403:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664275.008709:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140491008:0@lo:400:kworker.0 00000100:00100000:0.0:1788664275.008749:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664275.008947:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140491008 00000100:00100000:3.0:1788664275.008952:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140491008 00000100:00100000:3.0:1788664275.008989:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788664275.008997:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140491008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664275.009173:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140491136:0@lo:400:kworker.0 00000100:00100000:2.0:1788664275.009207:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664275.009241:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140491136 00000100:00100000:2.0:1788664275.009245:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140491136 00000100:00100000:2.0:1788664275.009274:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788664275.009280:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140491136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664275.009317:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140491136:12345-0@lo:400:kworker.0 Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664275.009324:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788664275.009355:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140491136:0@lo:400:kworker.0 00000100:00100000:3.0:1788664275.015048:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140491008:12345-0@lo:400:kworker.0 Request processed in 6042us (6288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664275.015065:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788664275.015465:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140491392:0@lo:400:kworker.0 00000100:00100000:3.0:1788664275.015544:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664275.015695:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140491904:0@lo:400:kworker.0 00000100:00100000:3.0:1788664275.015736:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664275.015758:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140492416:0@lo:400:kworker.0 00000100:00100000:2.0:1788664275.015815:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140491264:0@lo:400:kworker.0 00000100:00100000:3.0:1788664275.015818:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664275.015868:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664275.015882:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140491904 00000100:00100000:3.0:1788664275.015889:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140491904 00000100:00100000:2.0:1788664275.015897:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140491776:0@lo:400:kworker.0 00000100:00100000:2.0:1788664275.015928:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664275.015937:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140492416 00000100:00100000:3.0:1788664275.015940:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140492416 00000100:00100000:3.0:1788664275.015971:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788664275.015979:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140491904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664275.016035:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140491904:12345-0@lo:400:kworker.0 Request processed in 57us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664275.016041:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788664275.016053:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788664275.016059:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140492416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664275.016098:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140492416:12345-0@lo:400:kworker.0 Request processed in 39us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664275.016102:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788664275.016139:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140491648:0@lo:400:kworker.0 00010000:00080000:3.0:1788664275.016193:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b15880 x1875550140491904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664275.016206:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140491904:0@lo:400:kworker.0 00000100:00100000:3.0:1788664275.016217:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140492416:0@lo:400:kworker.0 00000100:00100000:3.0:1788664275.016261:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140491264 00000100:00100000:3.0:1788664275.016271:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140491264 00000100:00100000:3.0:1788664275.016297:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788664275.016303:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140491264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664275.016338:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140491264:12345-0@lo:400:kworker.0 Request processed in 35us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664275.016344:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788664275.018559:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140492288:0@lo:400:kworker.0 00000100:00100000:2.0:1788664275.018622:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664275.019258:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140491392 00000100:00100000:1.0:1788664275.019267:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140491392 00000100:00100000:1.0:1788664275.019315:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140491776 00000100:00100000:1.0:1788664275.019318:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140491776 00000100:00100000:1.0:1788664275.019346:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788664275.019354:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140491392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664275.019417:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140491392:12345-0@lo:400:kworker.0 Request processed in 64us (3872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664275.019424:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788664275.019439:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788664275.019445:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140491776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664275.019472:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140491776:12345-0@lo:400:kworker.0 Request processed in 28us (3545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664275.019477:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:1.0:1788664275.020071:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664275.020088:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664275.020091:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664275.020141:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140491392:0@lo:400:kworker.0 00000100:00100000:0.0:1788664275.021053:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140491008:0@lo:400:kworker.0 00000100:00100000:0.0:1788664275.021114:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140491520:0@lo:400:kworker.0 00000100:00100000:0.0:1788664275.021186:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664275.021239:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140491520 00000100:00100000:0.0:1788664275.021245:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140491520 00000100:00100000:0.0:1788664275.021285:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788664275.021293:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140491520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664275.021337:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140491520:12345-0@lo:400:kworker.0 Request processed in 45us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664275.021344:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788664275.021719:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140491520:0@lo:400:kworker.0 00000100:00100000:0.0:1788664275.021727:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140492032:0@lo:400:kworker.0 00000100:00100000:0.0:1788664275.021757:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664275.021813:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140492032 00000100:00100000:0.0:1788664275.021817:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140492032 00000100:00100000:0.0:1788664275.021871:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788664275.021877:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140492032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664275.021912:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140492032:12345-0@lo:400:kworker.0 Request processed in 35us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664275.021918:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1788664275.021933:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788664275.021954:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b16d80 x1875550140492032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664275.021965:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140492032:0@lo:400:kworker.0 00000100:00100000:2.0:1788664275.027710:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140491264:0@lo:400:kworker.0 00010000:00080000:2.0:1788664275.027732:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b15500 x1875550140491776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664275.027743:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140491776:0@lo:400:kworker.0 00000100:00100000:0.0:1788664275.028297:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140492288 00000100:00100000:0.0:1788664275.028311:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140492288 00000100:00100000:0.0:1788664275.028365:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788664275.028467:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664275.028499:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140492160:0@lo:400:kworker.0 00000100:00100000:3.0:1788664275.028653:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140491648 00000100:00100000:0.0:1788664275.028654:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140492288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664275.028657:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140491648 00000100:00100000:3.0:1788664275.028684:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788664275.028690:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140491648:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788664275.028742:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664275.028746:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788664275.034730:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140492288:12345-0@lo:400:kworker.0 Request processed in 6069us (16095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664275.034745:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00010000:00080000:2.0:1788664275.034989:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b15f80 x1875550140492288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664275.035006:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140492288:0@lo:400:kworker.0 00000100:00100000:3.0:1788664275.036629:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140491648:12345-0@lo:400:kworker.0 Request processed in 7932us (8156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664275.036642:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788664275.036749:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664275.037933:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140491648:0@lo:400:kworker.0 00000100:00100000:3.0:1788664275.038040:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140492160 00000100:00100000:3.0:1788664275.038047:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140492160 00000100:00100000:3.0:1788664275.038117:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788664275.038127:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140492160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664275.038210:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140492160:12345-0@lo:400:kworker.0 Request processed in 85us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664275.038218:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788664275.038320:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140492160:0@lo:400:kworker.0 00000100:00080000:2.0:1788664275.038989:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788664275.391053:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664275.518486:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140492544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664275.518565:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664275.519138:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140492544 00000100:00100000:2.0:1788664275.519148:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140492544 00000100:00100000:2.0:1788664275.519203:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788664275.519213:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140492544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788664275.519248:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664275.519306:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140492544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664275.519313:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788664275.519467:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140492544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664275.605491:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664275.605537:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664275.605562:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664275.605602:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664275.605637:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664275.605673:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664275.605716:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119425792 00000100:00100000:1.0:1788664275.605726:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119425792 00000100:00100000:3.0:1788664275.605732:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119426176 00000100:00100000:3.0:1788664275.605736:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119426176 00000100:00100000:3.0:1788664275.605809:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:1.0:1788664275.605809:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 376 00000100:00100000:3.0:1788664275.605819:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119426176:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664275.605831:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2392:x1875550119425792:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:0.0:1788664275.605896:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664275.605923:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119425920 00000100:00100000:0.0:1788664275.605927:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119425920 00000100:00100000:0.0:1788664275.605959:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119426432 00000100:00100000:0.0:1788664275.605962:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119426432 00000100:00100000:0.0:1788664275.605973:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119426048 00000100:00100000:0.0:1788664275.605975:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119426048 00000100:00100000:0.0:1788664275.605984:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119426304 00000100:00100000:0.0:1788664275.605986:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119426304 00000100:00100000:0.0:1788664275.606000:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 264 00000100:00100000:0.0:1788664275.606005:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119425920:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664275.606074:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119426176:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 256us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664275.606081:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:2.0:1788664275.606224:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 265 00000100:00100000:2.0:1788664275.606234:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2392:x1875550119426432:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664275.609897:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2392:x1875550119425792:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 4051us (4278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664275.609912:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 376 00000100:00100000:1.0:1788664275.610021:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 266 00000100:00100000:1.0:1788664275.610037:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119426048:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664275.610091:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119426048:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 61us (4453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664275.610577:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 266 00000100:00100000:1.0:1788664275.610605:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 267 00000100:00100000:1.0:1788664275.610614:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2392:x1875550119426304:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664275.610649:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2392:x1875550119426304:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 38us (4976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664275.610655:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 267 00000100:00080000:1.0:1788664275.610699:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664275.610705:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664275.611001:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119425920:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 4992us (5515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664275.611010:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 264 00000100:00100000:2.0:1788664275.611476:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2392:x1875550119426432:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 5241us (5909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664275.611485:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 265 00000100:00100000:0.0:1788664276.030183:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664276.030363:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140492672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788664276.038667:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664276.038875:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140492672 00000100:00100000:3.0:1788664276.038886:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140492672 00000100:00100000:3.0:1788664276.038968:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788664276.038979:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140492672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788664276.039017:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788664276.039079:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140492672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664276.039086:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788664276.039206:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140492672:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788664276.414052:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664276.542158:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140492800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664276.542233:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664276.544094:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140492800 00000100:00100000:0.0:1788664276.544106:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140492800 00000100:00100000:0.0:1788664276.544173:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788664276.544184:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140492800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664276.544216:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664276.544303:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140492800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (2070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664276.544310:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:1.0:1788664276.544474:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3040b5180 x1875550140492800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664276.544495:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140492800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664276.547665:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664276.556635:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140492928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788664276.556722:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664276.557165:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140492928 00000100:00100000:3.0:1788664276.557173:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140492928 00000100:00100000:3.0:1788664276.557229:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788664276.557239:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140492928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788664276.557264:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664276.557320:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140492928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664276.557326:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:2.0:1788664276.557514:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b72d80 x1875550140492928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664276.557533:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140492928:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788664277.437922:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664278.469255:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664279.486000:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664279.614529:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140493056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664279.614623:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664279.615805:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140493056 00000100:00100000:3.0:1788664279.615817:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140493056 00000100:00100000:3.0:1788664279.615881:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788664279.615892:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140493056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664279.615989:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788664279.616174:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140493056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 284us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664279.616182:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788664279.628031:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140493056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664280.125996:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664280.126020:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140493312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664280.126021:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140493184:0@lo:400:kworker.0 00000100:00100000:3.0:1788664280.126103:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664280.126115:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140493440:0@lo:400:kworker.0 00000100:00100000:1.0:1788664280.126232:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140493568:0@lo:400:kworker.0 00000100:00100000:0.0:1788664280.133090:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664280.133171:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140493696:0@lo:400:kworker.0 00000100:00100000:0.0:1788664280.133226:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664280.133256:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140494208:0@lo:400:kworker.0 00000100:00100000:0.0:1788664280.133282:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664280.133301:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140494720:0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.134190:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664280.134245:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140493952:0@lo:400:kworker.0 00000100:00100000:0.0:1788664280.134259:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664280.134294:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664280.134318:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140494464:0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.134340:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664280.134360:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788664280.134367:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140493824:0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.134392:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664280.134411:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140494336:0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.134432:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664280.134456:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140494848:0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.134496:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664280.134526:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140494208 00000100:00100000:2.0:1788664280.134546:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140494208 00000100:00100000:2.0:1788664280.134595:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140494720 00000100:00100000:2.0:1788664280.134598:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140494720 00000100:00100000:2.0:1788664280.134611:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140494336 00000100:00100000:2.0:1788664280.134613:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140494336 00000100:00100000:2.0:1788664280.134625:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140494848 00000100:00100000:2.0:1788664280.134627:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140494848 00000100:00100000:2.0:1788664280.134640:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788664280.134648:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140494208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664280.136155:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140493184 00000100:00100000:0.0:1788664280.136167:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140493184 00000100:00100000:0.0:1788664280.136224:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788664280.136234:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140493184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664280.136300:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788664280.136312:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140494720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664280.136371:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140493696 00000100:00100000:1.0:1788664280.136377:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140493696 00000100:00100000:2.0:1788664280.136408:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140494208:12345-0@lo:400:kworker.0 Request processed in 1758us (3122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664280.136417:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788664280.136436:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788664280.136444:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140494336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664280.136454:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140493952 00000100:00100000:1.0:1788664280.136459:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140493952 00000100:00100000:2.0:1788664280.136485:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140494336:12345-0@lo:400:kworker.0 Request processed in 42us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664280.136491:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788664280.136502:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140494464 00000100:00100000:1.0:1788664280.136507:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140494464 00000100:00100000:2.0:1788664280.136510:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788664280.136519:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140494848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664280.136533:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788664280.136542:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140493696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.137305:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140494848:12345-0@lo:400:kworker.0 Request processed in 783us (2803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664280.137313:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788664280.137344:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788664280.137353:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140493952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.137387:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140493952:12345-0@lo:400:kworker.0 Request processed in 36us (3093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664280.137409:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788664280.137427:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788664280.137434:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140494464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.137463:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140494464:12345-0@lo:400:kworker.0 Request processed in 31us (3123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664280.137468:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788664280.137492:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140493824 00000100:00100000:2.0:1788664280.137497:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140493824 00000100:00100000:2.0:1788664280.137527:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788664280.137617:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140493824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.137652:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140493824:12345-0@lo:400:kworker.0 Request processed in 118us (3259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664280.137658:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1788664280.137678:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664280.137683:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664280.137685:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664280.137697:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140493312 00000100:00100000:2.0:1788664280.137701:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140493312 00000100:00100000:2.0:1788664280.137725:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788664280.137731:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140493312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664280.137763:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664280.137810:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140493312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (3634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664280.137816:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788664280.137859:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140493824:0@lo:400:kworker.0 00010000:00080000:2.0:1788664280.137875:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b15500 x1875550140494336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664280.137893:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140494336:0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.137907:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140494848:0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.137931:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140493952:0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.137941:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140494464:0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.137956:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140493312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664280.138048:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664280.138073:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140493440 00000100:00100000:2.0:1788664280.138077:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140493440 00000100:00100000:2.0:1788664280.138098:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788664280.138104:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140493440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.138133:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140493440:12345-0@lo:400:kworker.0 Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664280.138139:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788664280.138168:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140493440:0@lo:400:kworker.0 00000100:00100000:0.0:1788664280.139010:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140493184:12345-0@lo:400:kworker.0 Request processed in 2773us (5923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664280.139022:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788664280.140416:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140494720:12345-0@lo:400:kworker.0 Request processed in 4101us (6151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664280.140430:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788664280.144497:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140493696:12345-0@lo:400:kworker.0 Request processed in 7934us (11246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664280.144516:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788664280.144604:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664280.144664:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140494080:0@lo:400:kworker.0 00000100:00100000:1.0:1788664280.144707:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664280.144733:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140494592:0@lo:400:kworker.0 00000100:00100000:1.0:1788664280.144765:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664280.145008:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140494080 00000100:00100000:2.0:1788664280.145017:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140494080 00000100:00100000:2.0:1788664280.145061:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140494592 00000100:00100000:2.0:1788664280.145064:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140494592 00000100:00100000:2.0:1788664280.145083:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788664280.145091:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140494080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.145165:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140494080:12345-0@lo:400:kworker.0 Request processed in 75us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664280.145172:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788664280.145193:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788664280.145199:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140494592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664280.145230:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140494592:12345-0@lo:400:kworker.0 Request processed in 32us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664280.145236:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:2.0:1788664280.145253:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788664280.145453:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b16d80 x1875550140494592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664280.145468:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140494592:0@lo:400:kworker.0 00010000:00080000:1.0:1788664280.145539:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b16680 x1875550140494080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664280.145548:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140494080:0@lo:400:kworker.0 00000100:00100000:3.0:1788664280.146173:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140493568 00000100:00100000:3.0:1788664280.146180:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140493568 00000100:00100000:3.0:1788664280.146229:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788664280.146237:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140493568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664280.146300:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140493568:12345-0@lo:400:kworker.0 Request processed in 64us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664280.146461:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140493568:0@lo:400:kworker.0 00000100:00100000:3.0:1788664280.146581:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788664280.148193:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140493696:0@lo:400:kworker.0 00010000:00080000:0.0:1788664280.148217:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b15f80 x1875550140494208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664280.148230:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140494208:0@lo:400:kworker.0 00000100:00100000:0.0:1788664280.148243:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140494720:0@lo:400:kworker.0 00000100:00100000:0.0:1788664280.148276:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140493184:0@lo:400:kworker.0 00010000:00010000:2.0:1788664280.515987:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664280.642546:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140494976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664280.642627:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664280.644142:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140494976 00000100:00100000:0.0:1788664280.644155:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140494976 00000100:00100000:0.0:1788664280.644213:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788664280.644223:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140494976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664280.644249:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664280.644323:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140494976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664280.644330:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788664280.644384:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140494976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664280.729318:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664280.729431:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664280.729467:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664280.729499:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664280.729554:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119426560 00000100:00100000:2.0:1788664280.729566:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119426560 00000100:00100000:2.0:1788664280.729622:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 378 00000100:00100000:2.0:1788664280.729633:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42dad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119426560:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664280.729706:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42dad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119426560:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 75us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664280.729714:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 378 00000100:00100000:3.0:1788664280.731951:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119426944 00000100:00100000:3.0:1788664280.731976:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119426944 00000100:00100000:3.0:1788664280.732064:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:3.0:1788664280.732075:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119426944:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664280.732148:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119426944:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 75us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664280.732156:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00080000:2.0:1788664280.733829:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664280.734939:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664280.742803:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119426688 00000100:00100000:1.0:1788664280.742823:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119426688 00000100:00100000:3.0:1788664280.743077:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119426816 00000100:00100000:3.0:1788664280.743082:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119426816 00000100:00100000:3.0:1788664280.743116:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 274 00000100:00100000:3.0:1788664280.743126:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119426688:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664280.743229:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119426688:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 105us (13932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664280.743253:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 274 00000100:00100000:3.0:1788664280.743273:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 275 00000100:00100000:3.0:1788664280.743280:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119426816:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664280.743320:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119426816:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 40us (13820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664280.743327:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 275 00000100:00080000:1.0:1788664280.743825:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664280.743830:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664280.744032:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664280.744056:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119427200 00000100:00100000:0.0:1788664280.744060:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119427200 00000100:00100000:0.0:1788664280.744092:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119427072 00000100:00100000:0.0:1788664280.744095:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119427072 00000100:00100000:0.0:1788664280.744113:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 276 00000100:00100000:0.0:1788664280.744120:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119427200:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664280.744155:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119427200:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 35us (9225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664280.744162:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 276 00000100:00100000:0.0:1788664280.744174:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 277 00000100:00100000:0.0:1788664280.744189:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119427072:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664280.744242:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119427072:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 54us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664280.744248:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 277 00000100:00080000:0.0:1788664280.744263:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664280.744265:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788664281.151868:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664281.151891:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43535a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140495104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788664281.151967:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664281.152246:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140495104 00000100:00100000:2.0:1788664281.152255:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140495104 00000100:00100000:2.0:1788664281.152319:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788664281.152328:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140495104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788664281.152367:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788664281.152427:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140495104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664281.152434:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788664281.152653:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43535a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140495104:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788664281.342479:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788664281.343473:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788664281.535584:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664281.663441:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788664281.663467:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140495360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664281.663503:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664281.663517:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140495232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664281.663555:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664281.663640:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664281.663671:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140495360 00000100:00100000:0.0:1788664281.663679:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140495360 00000100:00100000:0.0:1788664281.663738:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140495232 00000100:00100000:0.0:1788664281.663741:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140495232 00000100:00100000:3.0:1788664281.663803:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788664281.663817:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140495360:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664281.663838:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00002000:00000024:3.0:1788664281.663851:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664281.663862:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140495232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788664281.663892:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664281.663910:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140495360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664281.663918:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788664281.663961:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140495232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664281.663981:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:3.0:1788664281.663991:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b71f80 x1875550140495232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664281.664013:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140495232:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788664281.664028:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3040b4000 x1875550140495360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664281.664062:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140495360:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788664282.565238:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664283.584424:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664284.607974:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664284.734883:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664284.734908:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140495488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664284.734989:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664284.735356:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140495488 00000100:00100000:3.0:1788664284.735364:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140495488 00000100:00100000:3.0:1788664284.735415:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788664284.735424:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140495488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664284.735469:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788664284.735537:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140495488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664284.735544:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788664284.735735:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140495488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664285.246108:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43535a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140495616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664285.246193:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664285.246360:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140495616 00000100:00100000:2.0:1788664285.246368:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140495616 00000100:00100000:2.0:1788664285.246437:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788664285.246447:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140495616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664285.246478:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664285.246522:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140495616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664285.246529:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1788664285.246587:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664285.246657:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43535a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140495616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664285.247063:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140496000:0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.247101:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664285.247124:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4012e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140496512:0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.247159:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664285.247183:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4012e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140497024:0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.247214:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664285.247233:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788664285.247239:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140495872:0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.247261:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664285.247276:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140496384:0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.247296:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664285.247314:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4012e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140496896:0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.247334:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664285.247360:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140496000 00000100:00100000:0.0:1788664285.247365:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140496000 00000100:00100000:0.0:1788664285.247394:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788664285.247402:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140496000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.247445:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140496000:12345-0@lo:400:kworker.0 Request processed in 43us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664285.247462:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788664285.247483:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140496512 00000100:00100000:0.0:1788664285.247487:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140496512 00000100:00100000:0.0:1788664285.247512:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140497024 00000100:00100000:0.0:1788664285.247514:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140497024 00000100:00100000:0.0:1788664285.247524:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140495872 00000100:00100000:0.0:1788664285.247526:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140495872 00000100:00100000:0.0:1788664285.247534:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140496384 00000100:00100000:0.0:1788664285.247536:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140496384 00000100:00100000:0.0:1788664285.247546:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140496896 00000100:00100000:0.0:1788664285.247549:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140496896 00000100:00100000:0.0:1788664285.247562:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788664285.247568:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140496512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.247601:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140496512:12345-0@lo:400:kworker.0 Request processed in 33us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664285.247607:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788664285.247620:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788664285.247626:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140497024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.247652:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140497024:12345-0@lo:400:kworker.0 Request processed in 27us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664285.247658:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788664285.247670:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788664285.247675:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140495872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.247711:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140495872:12345-0@lo:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664285.247717:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788664285.247729:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788664285.247742:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140496384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.247769:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140496384:12345-0@lo:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664285.247813:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788664285.247826:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788664285.247832:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140496896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.247858:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140496896:12345-0@lo:400:kworker.0 Request processed in 27us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664285.247863:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:0.0:1788664285.247882:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664285.247886:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788664285.247909:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140495872:0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.247918:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140496384:0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.247925:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4012e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140496896:0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.247933:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140496000:0@lo:400:kworker.0 00010000:00080000:0.0:1788664285.247945:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4012e8380 x1875550140496512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664285.247956:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4012e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140496512:0@lo:400:kworker.0 00010000:00080000:0.0:1788664285.247965:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4012e9500 x1875550140497024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664285.247974:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4012e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140497024:0@lo:400:kworker.0 00000100:00100000:3.0:1788664285.248147:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140496128:0@lo:400:kworker.0 00000100:00100000:3.0:1788664285.248180:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664285.248209:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4012ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140496640:0@lo:400:kworker.0 00000100:00100000:3.0:1788664285.248232:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664285.248250:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4012e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140497152:0@lo:400:kworker.0 00000100:00100000:3.0:1788664285.248272:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664285.248291:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788664285.248296:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140495744:0@lo:400:kworker.0 00000100:00100000:3.0:1788664285.248336:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664285.248358:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140496256:0@lo:400:kworker.0 00000100:00100000:3.0:1788664285.248382:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664285.248398:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4012e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140496768:0@lo:400:kworker.0 00000100:00100000:3.0:1788664285.248417:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664285.248443:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140496640 00000100:00100000:3.0:1788664285.248447:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140496640 00000100:00100000:3.0:1788664285.248477:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140497152 00000100:00100000:3.0:1788664285.248480:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140497152 00000100:00100000:3.0:1788664285.248493:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140496768 00000100:00100000:3.0:1788664285.248495:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140496768 00000100:00100000:3.0:1788664285.248507:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788664285.248513:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140496640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664285.248552:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140496640:12345-0@lo:400:kworker.0 Request processed in 38us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664285.248570:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788664285.248583:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788664285.248589:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140497152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664285.248619:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140497152:12345-0@lo:400:kworker.0 Request processed in 30us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664285.248625:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788664285.248635:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788664285.248641:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140496768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664285.248668:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140496768:12345-0@lo:400:kworker.0 Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664285.248674:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:3.0:1788664285.248715:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4012e8000 x1875550140496768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664285.248726:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4012e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140496768:0@lo:400:kworker.0 00010000:00080000:3.0:1788664285.248736:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4012ebb80 x1875550140496640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664285.248744:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4012ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140496640:0@lo:400:kworker.0 00000100:00100000:3.0:1788664285.248753:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4012e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140497152:0@lo:400:kworker.0 00000100:00100000:3.0:1788664285.248801:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140496128 00000100:00100000:3.0:1788664285.248805:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140496128 00000100:00100000:3.0:1788664285.248827:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788664285.248833:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140496128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664285.248869:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140496128:12345-0@lo:400:kworker.0 Request processed in 36us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664285.248881:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788664285.248906:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140496128:0@lo:400:kworker.0 00000100:00100000:2.0:1788664285.249247:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140496256 00000100:00100000:2.0:1788664285.249252:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140496256 00000100:00100000:2.0:1788664285.249288:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788664285.249296:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140496256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664285.249337:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140496256:12345-0@lo:400:kworker.0 Request processed in 43us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664285.249343:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788664285.249907:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140495744 00000100:00100000:0.0:1788664285.249922:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140495744 00000100:00100000:0.0:1788664285.249970:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788664285.249978:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140495744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664285.250021:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140495744:12345-0@lo:400:kworker.0 Request processed in 44us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664285.250028:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00080000:0.0:1788664285.250057:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664285.250061:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664285.250348:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140495744:0@lo:400:kworker.0 00000100:00100000:3.0:1788664285.250361:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140496256:0@lo:400:kworker.0 00010000:00010000:3.0:1788664285.630060:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664285.758730:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664285.758754:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43535a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140497280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788664285.758883:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664285.759137:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140497280 00000100:00100000:0.0:1788664285.759146:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140497280 00000100:00100000:0.0:1788664285.759206:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788664285.759216:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140497280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664285.759242:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664285.759298:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140497280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664285.759305:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788664285.759422:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43535a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140497280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664285.850835:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664285.850881:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664285.850915:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664285.851075:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119427328 00000100:00100000:2.0:1788664285.851086:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119427328 00000100:00100000:2.0:1788664285.851141:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 380 00000100:00100000:2.0:1788664285.851151:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119427328:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664285.851348:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119427328:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 197us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664285.851356:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 380 00000100:00100000:3.0:1788664285.851750:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119427584 00000100:00100000:3.0:1788664285.851756:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119427584 00000100:00100000:3.0:1788664285.851827:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119427456 00000100:00100000:3.0:1788664285.851831:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119427456 00000100:00100000:3.0:1788664285.851853:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 284 00000100:00100000:3.0:1788664285.851860:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119427584:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664285.851902:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119427584:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 42us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664285.851908:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 284 00000100:00100000:3.0:1788664285.851921:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 285 00000100:00100000:3.0:1788664285.851927:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119427456:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664285.851962:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119427456:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 35us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664285.851968:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 285 00000100:00080000:2.0:1788664285.854650:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664285.854660:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788664285.862722:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664285.862889:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119427712 00000100:00100000:3.0:1788664285.862899:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119427712 00000100:00100000:3.0:1788664285.863032:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788664285.863041:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2389:x1875550119427712:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:3.0:1788664285.863070:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d940 00000100:00080000:3.0:1788664285.863078:0:8426:0:(import.c:65:import_set_state_nolock()) ffff93c43513d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788664285.863126:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1788664285.863559:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+2:2389:x1875550119427712:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 516us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664285.863567:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00010000:00010000:1.0:1788664285.863966:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664285.867156:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664285.867199:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664285.867265:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119427840 00000100:00100000:0.0:1788664285.867276:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119427840 00000100:00100000:0.0:1788664285.867331:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119427968 00000100:00100000:0.0:1788664285.867334:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119427968 00000100:00100000:0.0:1788664285.867359:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 286 00000100:00100000:0.0:1788664285.867368:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119427840:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664285.867440:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119427840:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 73us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664285.867466:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 286 00000100:00100000:0.0:1788664285.867482:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 287 00000100:00100000:0.0:1788664285.867488:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119427968:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664285.867513:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119427968:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664285.867519:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 287 00000100:00080000:2.0:1788664285.870032:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788664285.870043:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664285.870046:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664286.272491:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43535a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140497408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788664286.272560:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664286.272618:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140497408 00000100:00100000:3.0:1788664286.272626:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140497408 00000100:00100000:3.0:1788664286.272674:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788664286.272727:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140497408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788664286.272763:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788664286.272848:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140497408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664286.272915:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43535a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140497408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788664286.275854:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00010000:00010000:0.0:1788664286.654002:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664286.782080:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4012eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140497536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664286.782153:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664286.782466:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664286.782476:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140497664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788664286.782511:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664286.782800:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140497536 00000100:00100000:0.0:1788664286.782808:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140497536 00000100:00100000:0.0:1788664286.782854:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140497664 00000100:00100000:0.0:1788664286.782857:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140497664 00000100:00100000:0.0:1788664286.782872:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788664286.782881:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140497536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664286.782910:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664286.782956:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140497536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664286.782963:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788664286.782978:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788664286.782984:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140497664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788664286.782994:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664286.783020:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140497664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664286.783039:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:2.0:1788664286.783128:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303705180 x1875550140497664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664286.783149:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140497664:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788664286.783488:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4012eaa00 x1875550140497536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664286.783502:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4012eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140497536:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788664287.678041:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664288.702213:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664289.726499:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664289.858126:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140497792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664289.858205:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664289.866070:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140497792 00000100:00100000:3.0:1788664289.866086:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140497792 00000100:00100000:3.0:1788664289.866160:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788664289.866171:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140497792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664289.866211:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788664289.866308:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140497792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (8106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664289.866316:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788664289.866468:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140497792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664290.366007:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140497920:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.366236:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664290.366289:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664290.366295:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4012eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140498048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664290.366319:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664290.366372:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140497920 00000100:00100000:0.0:1788664290.366380:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140497920 00000100:00100000:0.0:1788664290.366423:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788664290.366431:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140497920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664290.366509:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140497920:12345-0@lo:400:kworker.0 Request processed in 78us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664290.366516:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788664290.366586:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140497920:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.369752:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140498048 00000100:00100000:3.0:1788664290.369765:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140498048 00000100:00100000:3.0:1788664290.369858:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788664290.369869:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140498048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664290.369903:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664290.369991:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140498048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (3669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664290.369999:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788664290.370033:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4012eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140498048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664290.370070:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140498176:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.370106:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664290.370149:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140498176 00000100:00100000:1.0:1788664290.370154:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140498176 00000100:00100000:3.0:1788664290.370178:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140498304:0@lo:400:kworker.0 00000100:00100000:1.0:1788664290.370189:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788664290.370198:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140498176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.370212:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664290.370247:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140498304 00000100:00100000:3.0:1788664290.370253:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140498304 00000100:00100000:1.0:1788664290.370259:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140498176:12345-0@lo:400:kworker.0 Request processed in 61us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664290.370275:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788664290.370284:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788664290.370294:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140498304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.370343:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140498304:12345-0@lo:400:kworker.0 Request processed in 51us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664290.370350:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788664290.370381:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140498176:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.370416:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140498432:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.370448:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664290.370492:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140498560:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.370514:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664290.370540:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140498560 00000100:00100000:3.0:1788664290.370544:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140498560 00000100:00100000:3.0:1788664290.370566:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788664290.370570:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140498560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.370605:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140498560:12345-0@lo:400:kworker.0 Request processed in 33us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664290.370612:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788664290.370619:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140498304:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.370647:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140498560:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.370703:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788664290.370710:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140498688:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.370736:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664290.370816:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140498432 00000100:00100000:3.0:1788664290.370817:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140498816:0@lo:400:kworker.0 00000100:00100000:1.0:1788664290.370821:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140498432 00000100:00100000:3.0:1788664290.370851:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664290.370852:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140498688 00000100:00100000:1.0:1788664290.370856:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140498688 00000100:00100000:1.0:1788664290.370872:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140498816 00000100:00100000:1.0:1788664290.370874:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140498816 00000100:00100000:3.0:1788664290.370890:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788664290.370900:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140498432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.370933:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140498432:12345-0@lo:400:kworker.0 Request processed in 35us (484us total) trans 0 rc 0/0 00000100:00080000:0.0:1788664290.370982:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788664290.370987:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664290.370989:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788664290.371225:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788664290.371235:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140498688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664290.371276:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140498688:12345-0@lo:400:kworker.0 Request processed in 43us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664290.371283:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788664290.371296:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788664290.371301:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140498816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664290.371325:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140498816:12345-0@lo:400:kworker.0 Request processed in 24us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664290.371330:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788664290.372455:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00010000:00080000:3.0:1788664290.372524:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c405329f80 x1875550140498816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664290.372536:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140498816:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.372566:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140498688:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.372608:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140498432:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.372656:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664290.372680:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140498944:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.372722:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664290.372756:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140498944 00000100:00100000:3.0:1788664290.372762:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140498944 00000100:00100000:3.0:1788664290.372823:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788664290.372831:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140498944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.372872:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140498944:12345-0@lo:400:kworker.0 Request processed in 42us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664290.372878:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:3.0:1788664290.372905:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c405328380 x1875550140498944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664290.372914:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140498944:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.372940:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140499072:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.372961:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664290.372986:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140499072 00000100:00100000:3.0:1788664290.372990:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140499072 00000100:00100000:3.0:1788664290.373014:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788664290.373020:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140499072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.373052:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140499072:12345-0@lo:400:kworker.0 Request processed in 32us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664290.373058:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:3.0:1788664290.373095:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c405328380 x1875550140499072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664290.373105:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140499072:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.373133:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140499200:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.373157:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664290.373197:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c40532b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140499328:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.373227:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664290.373254:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140499200 00000100:00100000:3.0:1788664290.373257:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140499200 00000100:00100000:3.0:1788664290.373280:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140499328 00000100:00100000:3.0:1788664290.373283:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140499328 00000100:00100000:3.0:1788664290.373297:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788664290.373303:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140499200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.373337:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140499200:12345-0@lo:400:kworker.0 Request processed in 35us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664290.373344:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788664290.373354:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788664290.373361:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140499328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.373391:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140499328:12345-0@lo:400:kworker.0 Request processed in 31us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664290.373396:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788664290.373422:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140499200:0@lo:400:kworker.0 00010000:00080000:3.0:1788664290.373442:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c40532b100 x1875550140499328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664290.373450:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c40532b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140499328:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.373488:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664290.373495:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c40532b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140499456:0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.373519:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664290.373539:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140499456 00000100:00100000:3.0:1788664290.373543:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140499456 00000100:00100000:3.0:1788664290.373566:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788664290.373572:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140499456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664290.373605:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140499456:12345-0@lo:400:kworker.0 Request processed in 33us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664290.373611:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788664290.373636:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c40532b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140499456:0@lo:400:kworker.0 00000100:00080000:0.0:1788664290.378714:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664290.378725:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788664290.378728:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664290.378731:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788664290.749913:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664290.884956:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140499584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664290.885021:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664290.885089:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140499584 00000100:00100000:2.0:1788664290.885096:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140499584 00000100:00100000:2.0:1788664290.885138:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788664290.885146:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140499584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788664290.885170:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664290.885207:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140499584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664290.885213:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788664290.885253:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140499584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664290.965894:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664290.965934:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664290.965965:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664290.965986:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664290.966012:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664290.966039:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119428224 00000100:00100000:1.0:1788664290.966049:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119428224 00000100:00100000:1.0:1788664290.966105:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119428480 00000100:00100000:1.0:1788664290.966109:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119428480 00000100:00100000:1.0:1788664290.966139:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119428352 00000100:00100000:1.0:1788664290.966142:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119428352 00000100:00100000:1.0:1788664290.966154:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119428608 00000100:00100000:1.0:1788664290.966156:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119428608 00000100:00100000:1.0:1788664290.966173:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 294 00000100:00100000:1.0:1788664290.966183:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119428224:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664290.966259:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119428224:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 76us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664290.966267:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 294 00000100:00100000:1.0:1788664290.966286:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 295 00000100:00100000:1.0:1788664290.966293:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119428480:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664290.966318:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119428480:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664290.966325:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 295 00000100:00100000:1.0:1788664290.966351:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 296 00000100:00100000:1.0:1788664290.966357:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119428352:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664290.966389:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119428352:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664290.966395:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 296 00000100:00100000:1.0:1788664290.966576:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 297 00000100:00100000:1.0:1788664290.966585:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119428608:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664290.966612:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119428608:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664290.966618:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 297 00000100:00100000:1.0:1788664290.966641:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119428096 00000100:00100000:1.0:1788664290.966651:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119428096 00000100:00100000:1.0:1788664290.966691:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 382 00000100:00100000:1.0:1788664290.966698:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119428096:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664290.966723:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119428096:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664290.966729:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 382 00000100:00080000:1.0:1788664290.966762:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664290.966766:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664291.390125:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140499712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788664291.390196:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664291.390315:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140499712 00000100:00100000:2.0:1788664291.390324:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140499712 00000100:00100000:2.0:1788664291.390385:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788664291.390395:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140499712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788664291.390430:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788664291.390479:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140499712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664291.390486:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788664291.390625:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140499712:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788664291.582789:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788664291.584622:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788664291.773891:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664291.903066:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4012e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140499840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664291.903139:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664291.903227:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140499840 00000100:00100000:0.0:1788664291.903235:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140499840 00000100:00100000:0.0:1788664291.903290:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788664291.903300:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140499840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664291.903334:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664291.903385:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140499840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664291.903392:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:0.0:1788664291.903435:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4012e8e00 x1875550140499840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664291.903455:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4012e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140499840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664291.906179:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c40532b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140499968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664291.906244:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664291.906308:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140499968 00000100:00100000:3.0:1788664291.906315:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140499968 00000100:00100000:3.0:1788664291.906358:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788664291.906367:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140499968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788664291.906390:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664291.906434:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140499968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664291.906441:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:3.0:1788664291.906479:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c40532b100 x1875550140499968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664291.906499:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c40532b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140499968:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1788664291.907559:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000020:00000080:3.0:1788664291.907565:0:9506:0:(genops.c:885:class_export_put()) final put ffff93c435138800/b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000020:00000080:1.0:1788664291.907633:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c435138800/b07edea8-5696-4cd5-9a12-cefd3a8358e9 for lustre-OST0001 00000020:00000080:1.0:1788664291.907691:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c43513d000 for lustre-OST0001 00010000:00010000:0.0:1788664292.798030:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664293.822259:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664294.846536:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664294.977031:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664294.977067:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c40532b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140500096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664294.977298:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664294.978469:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140500096 00000100:00100000:3.0:1788664294.978486:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140500096 00000100:00100000:3.0:1788664294.978567:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788664294.978580:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140500096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664294.978649:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788664294.978935:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140500096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 352us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664294.978947:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788664294.979113:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c40532b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140500096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664295.488367:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4012e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140500224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664295.488474:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664295.488543:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140500224 00000100:00100000:0.0:1788664295.488552:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140500224 00000100:00100000:0.0:1788664295.488602:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788664295.488610:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140500224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664295.488650:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664295.488695:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140500224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664295.488702:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1788664295.488720:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664295.488752:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4012e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140500224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664295.494166:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140500480:0@lo:400:kworker.0 00000100:00100000:2.0:1788664295.494435:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664295.494485:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140500992:0@lo:400:kworker.0 00000100:00100000:2.0:1788664295.494509:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664295.494532:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140501504:0@lo:400:kworker.0 00000100:00100000:2.0:1788664295.494553:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664295.494585:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788664295.494591:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140500608:0@lo:400:kworker.0 00000100:00100000:2.0:1788664295.494621:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664295.494651:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140501120:0@lo:400:kworker.0 00000100:00100000:2.0:1788664295.494676:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664295.494697:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140501632:0@lo:400:kworker.0 00000100:00100000:2.0:1788664295.494718:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664295.494757:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140500480 00000100:00100000:2.0:1788664295.494765:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140500480 00000100:00100000:2.0:1788664295.494833:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140500992 00000100:00100000:2.0:1788664295.494837:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140500992 00000100:00100000:2.0:1788664295.494863:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140501504 00000100:00100000:2.0:1788664295.494877:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140501504 00000100:00100000:0.0:1788664295.495298:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140500352:0@lo:400:kworker.0 00000100:00100000:0.0:1788664295.495340:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664295.495368:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140500864:0@lo:400:kworker.0 00000100:00100000:0.0:1788664295.495406:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664295.495458:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140501376:0@lo:400:kworker.0 00000100:00100000:0.0:1788664295.495479:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664295.495494:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788664295.495501:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140500736:0@lo:400:kworker.0 00000100:00100000:0.0:1788664295.495521:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664295.495531:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140501248:0@lo:400:kworker.0 00000100:00100000:0.0:1788664295.495549:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664295.495577:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140500352 00000100:00100000:0.0:1788664295.495582:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140500352 00000100:00100000:0.0:1788664295.495610:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788664295.495618:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140500352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664295.495681:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140500352:12345-0@lo:400:kworker.0 Request processed in 63us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664295.495687:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788664295.495717:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140501120 00000100:00100000:0.0:1788664295.495720:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140501120 00000100:00100000:0.0:1788664295.495743:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140501632 00000100:00100000:0.0:1788664295.495746:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140501632 00000100:00100000:0.0:1788664295.495758:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140501248 00000100:00100000:0.0:1788664295.495761:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140501248 00000100:00100000:0.0:1788664295.495791:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788664295.495798:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140501120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664295.495837:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140501120:12345-0@lo:400:kworker.0 Request processed in 40us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664295.495843:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788664295.495853:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788664295.495866:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140501632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664295.496140:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140500864 00000100:00100000:2.0:1788664295.496144:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140500864 00000100:00100000:2.0:1788664295.496158:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140501376 00000100:00100000:2.0:1788664295.496160:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140501376 00000100:00100000:2.0:1788664295.496172:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788664295.496312:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140500480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664295.496949:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140500352:0@lo:400:kworker.0 00000100:00100000:3.0:1788664295.498582:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788664295.498600:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140501248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664295.499980:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140500480:12345-0@lo:400:kworker.0 Request processed in 3665us (5540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664295.499993:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788664295.500026:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140500736 00000100:00100000:2.0:1788664295.500034:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140500736 00000100:00100000:2.0:1788664295.500063:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788664295.500071:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140500992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664295.500114:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140500992:12345-0@lo:400:kworker.0 Request processed in 45us (5605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664295.500121:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788664295.500133:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788664295.500140:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140501504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664295.500169:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140501504:12345-0@lo:400:kworker.0 Request processed in 30us (5616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664295.500175:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788664295.500188:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788664295.500195:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140500864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664295.501119:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140500864:12345-0@lo:400:kworker.0 Request processed in 921us (5708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664295.501127:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788664295.501163:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788664295.501171:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140501376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664295.501215:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140501376:12345-0@lo:400:kworker.0 Request processed in 46us (5735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664295.501221:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788664295.501233:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788664295.501240:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140500736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664295.501267:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140500736:12345-0@lo:400:kworker.0 Request processed in 28us (5745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664295.501272:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:2.0:1788664295.501305:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664295.501312:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664295.501315:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664295.501318:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788664295.501349:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e4380 x1875550140501120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664295.501363:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140501120:0@lo:400:kworker.0 00000100:00100000:2.0:1788664295.501376:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140500480:0@lo:400:kworker.0 00010000:00080000:2.0:1788664295.501386:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e7800 x1875550140500992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664295.501394:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140500992:0@lo:400:kworker.0 00010000:00080000:2.0:1788664295.501403:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43526f480 x1875550140501504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664295.501409:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140501504:0@lo:400:kworker.0 00000100:00100000:0.0:1788664295.501626:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140501632:12345-0@lo:400:kworker.0 Request processed in 5758us (6904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664295.501646:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788664295.503472:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140501632:0@lo:400:kworker.0 00000100:00100000:3.0:1788664295.505261:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140501248:12345-0@lo:400:kworker.0 Request processed in 6660us (9702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664295.505275:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788664295.505316:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140500608 00000100:00100000:3.0:1788664295.505324:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140500608 00000100:00100000:3.0:1788664295.505429:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788664295.505438:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140500608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664295.505500:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140500608:12345-0@lo:400:kworker.0 Request processed in 63us (10878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664295.505506:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788664295.507227:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140500864:0@lo:400:kworker.0 00000100:00100000:1.0:1788664295.507246:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140501376:0@lo:400:kworker.0 00000100:00100000:1.0:1788664295.507275:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140500736:0@lo:400:kworker.0 00010000:00080000:1.0:1788664295.507289:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e7b80 x1875550140501248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664295.507300:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140501248:0@lo:400:kworker.0 00000100:00100000:3.0:1788664295.510671:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140500608:0@lo:400:kworker.0 00000001:02000400:2.0:1788664295.527457:0:14058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:11:33 (1788664293) 00010000:00010000:0.0:1788664295.870502:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664295.998019:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664295.998112:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140501760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664295.998198:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664296.000507:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140501760 00000100:00100000:0.0:1788664296.000522:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140501760 00000100:00100000:0.0:1788664296.006139:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788664296.006156:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140501760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664296.006187:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664296.006289:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140501760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (8090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664296.006297:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788664296.006490:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140501760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664296.088729:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664296.088811:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664296.088862:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664296.088890:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664296.088929:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664296.089021:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119428864 00000100:00100000:3.0:1788664296.089034:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119428864 00000100:00100000:3.0:1788664296.089114:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119429120 00000100:00100000:3.0:1788664296.089136:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119429120 00000100:00100000:3.0:1788664296.089156:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119428992 00000100:00100000:3.0:1788664296.089159:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119428992 00000100:00100000:3.0:1788664296.089173:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119429248 00000100:00100000:3.0:1788664296.089188:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119429248 00000100:00100000:3.0:1788664296.089219:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 304 00000100:00080000:1.0:1788664296.089273:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664296.089283:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664296.089291:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119428736 00000100:00100000:0.0:1788664296.089309:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119428736 00000100:00100000:3.0:1788664296.089350:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119428864:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664296.089397:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 384 00000100:00100000:0.0:1788664296.089411:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2391:x1875550119428736:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664296.089470:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119428864:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 238us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664296.089500:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2391:x1875550119428736:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 90us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664296.089509:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 384 00000100:00100000:2.0:1788664296.099202:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 305 00000100:00100000:2.0:1788664296.099230:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119429120:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664296.099392:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119429120:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 107us (10510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664296.099403:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 305 00000100:00100000:2.0:1788664296.099443:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 306 00000100:00100000:2.0:1788664296.099451:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119428992:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664296.099485:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119428992:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 34us (10591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664296.099491:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 306 00000100:00100000:2.0:1788664296.099503:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 307 00000100:00100000:2.0:1788664296.099509:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119429248:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664296.099531:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119429248:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 22us (10602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664296.099537:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 307 00000100:00100000:3.0:1788664296.105879:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 304 00000100:00100000:1.0:1788664296.511576:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140501888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664296.511671:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664296.512754:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140501888 00000100:00100000:0.0:1788664296.512766:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140501888 00000100:00100000:0.0:1788664296.512856:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788664296.512867:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140501888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788664296.512904:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788664296.512991:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140501888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664296.513012:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788664296.513164:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140501888:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788664296.894063:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664297.022359:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788664297.022382:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c40532b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140502016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664297.022452:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664297.022608:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140502016 00000100:00100000:3.0:1788664297.022617:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140502016 00000100:00100000:3.0:1788664297.022694:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788664297.022704:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140502016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788664297.022733:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664297.022803:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140502016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664297.022811:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:3.0:1788664297.022846:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c40532b100 x1875550140502016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664297.022865:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c40532b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140502016:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788664297.022931:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664297.023318:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664297.023328:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c302b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140502144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664297.023376:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664297.023442:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140502144 00000100:00100000:1.0:1788664297.023447:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140502144 00000100:00100000:1.0:1788664297.023492:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788664297.023500:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140502144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664297.023512:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664297.023550:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140502144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664297.023556:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:1.0:1788664297.023585:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c302b45f80 x1875550140502144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664297.023598:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c302b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140502144:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788664297.023696:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664297.624148:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664297.624342:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119429376 00000100:00100000:2.0:1788664297.624352:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119429376 00000100:00100000:2.0:1788664297.624420:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:2.0:1788664297.624430:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:11059:x1875550119429376:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664297.624452:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664297.624522:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413da20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d276 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664297.624589:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413da27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664297.624604:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413da27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664297.624618:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413da27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664297.624677:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788664297.624682:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664297.624720:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413da27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664297.624743:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413da20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d276 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664297.624759:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413da27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d276 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664297.624838:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4130a6500) 00010000:00010000:2.0:1788664297.624841:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664297.624845:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d200, rc 0) 00000100:00100000:2.0:1788664297.624905:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:11059:x1875550119429376:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 477us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664297.624912:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:2.0:1788664297.655239:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664297.655391:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119429504 00000100:00100000:1.0:1788664297.655401:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119429504 00000100:00100000:1.0:1788664297.655466:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:1.0:1788664297.655489:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:11060:x1875550119429504:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664297.655510:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664297.655528:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413da2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d27d expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655588:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413da35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655602:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413da35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655613:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413da35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655641:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413da3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655649:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413da3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655656:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413da3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655718:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413da43 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655725:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413da43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655732:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413da43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664297.655818:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788664297.655822:0:9169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664297.655841:0:9169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413da43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655850:0:9169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413da35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655857:0:9169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413da35 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655863:0:9169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413da35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655869:0:9169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664297.655873:0:9169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413da35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655880:0:9169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413da35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655891:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4130a6500) 00010000:00010000:1.0:1788664297.655894:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664297.655898:0:9169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413da35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655904:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413da35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655915:0:9169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413da3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655931:0:9169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413da3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655936:0:9169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413da3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655941:0:9169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664297.655944:0:9169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413da3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655950:0:9169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413da3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655958:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93c3027e5600) 00010000:00010000:1.0:1788664297.655960:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664297.655963:0:9169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413da3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655968:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413da3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.655996:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413da2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d27d expref: 8 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.656008:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413da43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d27d expref: 7 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664297.656015:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c3027e5a00) 00010000:00010000:1.0:1788664297.656017:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788664297.656024:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b84000, rc 0) 00000100:00100000:1.0:1788664297.656091:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:11060:x1875550119429504:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 605us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664297.656098:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:1.0:1788664297.673882:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664297.673974:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119429632 00000100:00100000:2.0:1788664297.673984:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119429632 00000100:00100000:2.0:1788664297.674041:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788664297.674051:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:11060:x1875550119429632:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788664297.674145:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:11060:x1875550119429632:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 Request processed in 95us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664297.674153:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788664297.677379:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664297.677548:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119429888 00000100:00100000:3.0:1788664297.677559:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119429888 00000100:00100000:3.0:1788664297.677659:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:3.0:1788664297.677669:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:11060:x1875550119429888:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664297.677702:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664297.677734:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413da4a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.677826:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da51 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.677851:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da51 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.677863:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da51 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.677920:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da58 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.677929:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.677936:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678044:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413da5f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678053:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413da5f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678060:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413da5f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664297.678069:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788664297.678174:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da51 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678191:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da51 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678198:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da51 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678204:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351efe00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664297.678208:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da51 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678216:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da51 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678228:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c3027e5a00) 00010000:00010000:3.0:1788664297.678231:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664297.678236:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678243:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678257:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678264:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da58 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678269:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da58 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678275:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ef000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664297.678285:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da58 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678291:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da58 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678299:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93c4350d6700) 00010000:00010000:3.0:1788664297.678301:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664297.678304:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da58 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678310:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da58 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678978:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413da4a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d284 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.678995:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413da5f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d284 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664297.679003:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c4350d6600) 00010000:00010000:3.0:1788664297.679006:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664297.679009:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351ee200, rc 0) 00000100:00100000:3.0:1788664297.679079:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:11060:x1875550119429888:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1411us (1711us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788664297.679087:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:1.0:1788664297.683652:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664297.684038:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119430016 00000100:00100000:2.0:1788664297.684048:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119430016 00000100:00100000:2.0:1788664297.684101:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:2.0:1788664297.684111:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:11060:x1875550119430016:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788664297.684242:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:11060:x1875550119430016:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 131us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664297.684251:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1788664297.685968:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664297.686092:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119430144 00000100:00100000:3.0:1788664297.686100:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119430144 00000100:00100000:3.0:1788664297.686167:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:3.0:1788664297.686177:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40531a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:11060:x1875550119430144:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788664297.697533:0:9169:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 11293us 00000040:00080000:2.0:1788664297.727574:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788664297.727922:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40531a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:11060:x1875550119430144:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 41742us (41956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664297.727934:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000040:00080000:2.0:1788664297.731840:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788664297.920688:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664298.942807:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664299.793808:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664299.800286:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119430272 00000100:00100000:3.0:1788664299.800301:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119430272 00000100:00100000:3.0:1788664299.800388:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:3.0:1788664299.800399:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:11102:x1875550119430272:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664299.800420:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788664299.800428:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788664299.800441:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d28b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.800500:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413da74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.800515:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413da74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.800526:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413da74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.800539:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.800545:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.800726:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.800792:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413da74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.800809:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413da74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.800816:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413da74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.800823:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ee600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664299.800828:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413da74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.800836:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413da74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.800850:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4130a6500) 00010000:00010000:3.0:1788664299.800853:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664299.800858:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413da74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.800864:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413da74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.800875:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.801058:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.801064:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.801069:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351efe00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664299.801078:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.801084:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.801092:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93c4350d0400) 00010000:00010000:3.0:1788664299.801094:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664299.801098:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.801104:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413da7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.801138:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d28b expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.801149:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4130a6500) 00010000:00010000:3.0:1788664299.801151:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664299.801155:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d28b expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.802423:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351ef000, rc 0) 00000100:00100000:3.0:1788664299.802508:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:11102:x1875550119430272:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2108us (8739us total) trans 0 rc 301/301 00000100:00100000:3.0:1788664299.802517:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:3.0:1788664299.817162:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664299.817199:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119430528 00000100:00100000:3.0:1788664299.817209:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119430528 00000100:00100000:3.0:1788664299.817277:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:3.0:1788664299.817303:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:11102:x1875550119430528:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:3.0:1788664299.817364:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664299.817391:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413da27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d276 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.817412:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4130a6500) 00010000:00010000:3.0:1788664299.817423:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664299.817489:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413da82 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.817505:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413da82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.817516:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413da82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.817528:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413da89 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.817536:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413da89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.817543:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413da89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.818086:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413da90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.818098:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413da90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.818104:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413da90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664299.818126:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ac3bf21 reply state 00000000a614356c transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413da90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.818137:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413da90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.818143:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:3.0:1788664299.818145:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788664299.818148:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788664299.818152:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788664299.818159:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413da82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.818165:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413da82 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.818172:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413da82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.818178:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ef800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664299.818181:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413da82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.818188:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413da82 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.818195:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4350d0b00) 00010000:00010000:3.0:1788664299.818198:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664299.818201:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413da82 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.818214:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413da82 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664299.818229:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ac3bf21 reply state 00000000a614356c transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413da89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.818236:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413da89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.818242:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93c4350d0f00) 00010000:00010000:3.0:1788664299.818244:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788664299.818246:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788664299.818344:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:11102:x1875550119430528:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 1042us (1189us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788664299.818351:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:0.0:1788664299.896230:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664299.896345:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119430656 00000100:00100000:3.0:1788664299.896361:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119430656 00000100:00100000:3.0:1788664299.896460:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:3.0:1788664299.896473:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:11110:x1875550119430656:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:3.0:1788664299.896506:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664299.896536:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413da97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d292 expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.896639:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.896657:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.896699:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664299.896762:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788664299.896766:0:9169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788664299.896866:0:9169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.896897:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413da97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d292 expref: 12 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.896924:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d292 expref: 11 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.896937:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4350d0b00) 00010000:00010000:3.0:1788664299.896940:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788664299.896946:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351ef000, rc 0) 00000100:00100000:2.0:1788664299.897388:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:11110:x1875550119430656:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 914us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664299.897399:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00010000:00010000:2.0:1788664299.966136:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664299.979975:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664299.980160:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119430784 00000100:00100000:3.0:1788664299.980185:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119430784 00000100:00100000:3.0:1788664299.980275:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:3.0:1788664299.980290:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:11116:x1875550119430784:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788664299.980323:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664299.980356:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413daa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d299 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.980462:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413daac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.980519:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413daac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.980534:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413daac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.980549:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413dab3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.980557:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413dab3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.980564:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413dab3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.980678:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413daba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.980687:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413daba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.980695:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413daba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664299.980737:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788664299.980741:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788664299.981071:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413daba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.981089:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413daac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.981108:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413daac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.981115:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413daac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.981122:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ef800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664299.981128:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413daac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.981137:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413daac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.981152:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4350d0b00) 00010000:00010000:3.0:1788664299.981155:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664299.981161:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413daac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.982641:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413daac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.982675:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413dab3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.982681:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413dab3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.982689:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413dab3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.982695:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ee600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664299.982720:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413dab3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.982730:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413dab3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.982745:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93c4350d0f00) 00010000:00010000:3.0:1788664299.982748:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664299.982752:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413dab3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.982758:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee600/0xcd11f61c1413dab3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.983988:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413daa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d299 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.984021:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413daba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d299 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.984030:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:3.0:1788664299.984034:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788664299.984037:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351eec00, rc 0) 00000100:00100000:3.0:1788664299.984146:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+12:11116:x1875550119430784:12345-192.168.203.52@tcp:101:bash.0 Request processed in 3858us (4187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664299.984157:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:1.0:1788664299.991727:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664299.991971:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119431040 00000100:00100000:0.0:1788664299.991985:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119431040 00000100:00100000:0.0:1788664299.992095:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1788664299.992107:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40531bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+12:11116:x1875550119431040:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788664299.992137:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664299.992162:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413dac1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d2a0 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.992312:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dac8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.992330:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dac8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.992344:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dac8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.993526:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dacf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.993567:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dacf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.993580:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dacf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788664299.994008:0:9524:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788664299.994151:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dad6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.994161:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dad6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.994169:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dad6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.994200:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dac8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.994207:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dac8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.994214:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dac8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.994226:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664299.994231:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dac8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.994239:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dac8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.994263:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:0.0:1788664299.994267:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664299.994272:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dac8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.994279:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dac8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664299.994291:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abf0a600 reply state 00000000811e5a67 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dacf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.994301:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dacf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.994307:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c404785f00) 00010000:00010000:0.0:1788664299.994309:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788664299.994312:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788664299.994348:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413dac1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a0 expref: 15 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.994363:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dad6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a0 expref: 14 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.994371:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785b00) 00010000:00010000:0.0:1788664299.994373:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664299.994375:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956200, rc 0) 00000100:00100000:0.0:1788664299.994448:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40531bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:11116:x1875550119431040:12345-192.168.203.52@tcp:101:bash.0 Request processed in 2343us (2737us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788664299.994457:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1788664300.000905:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664300.001020:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119431168 00000100:00100000:3.0:1788664300.001038:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119431168 00000100:00100000:3.0:1788664300.001105:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1788664300.001115:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1875550119431168:12345-192.168.203.52@tcp:8:bash.0 00010000:00080000:3.0:1788664300.001185:0:8429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:3.0:1788664300.001230:0:8429:0:(genops.c:1385:class_connect()) connect: client b07edea8-5696-4cd5-9a12-cefd3a8358e9, cookie 0xcd11f61c1413dae4 00002000:00100000:3.0:1788664300.001249:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b07edea8-5696-4cd5-9a12-cefd3a8358e9/ffff93c40392e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788664300.001273:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788664300.001381:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788664300.001426:0:8429:0:(import.c:65:import_set_state_nolock()) ffff93c40392f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664300.001603:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2389:x1875550119431168:12345-192.168.203.52@tcp:8:bash.0 Request processed in 487us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664300.001621:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1788664300.008189:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664300.008294:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119431296 00000100:00100000:3.0:1788664300.008307:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119431296 00000100:00100000:3.0:1788664300.008403:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:3.0:1788664300.008415:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:0:x1875550119431296:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788664300.008442:0:9895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664300.008476:0:9895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413daeb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d2a7 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788664300.008512:0:9895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788664300.008538:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788664300.008549:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664300.008561:0:9895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413daeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a7 expref: 7 pid: 9895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.008584:0:9895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413daeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a7 expref: 7 pid: 9895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.008636:0:9895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351efe00, rc 0) 00000100:00100000:3.0:1788664300.008723:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:0:x1875550119431296:12345-192.168.203.52@tcp:101:bash.0 Request processed in 309us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664300.008730:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00080000:0.0:1788664300.008807:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664300.019947:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664300.020125:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119431424 00000100:00100000:3.0:1788664300.020138:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119431424 00000100:00100000:3.0:1788664300.020200:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1788664300.020211:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:11116:x1875550119431424:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788664300.020235:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664300.020259:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d2ae expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.020304:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413daeb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a7 expref: 8 pid: 9895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.020313:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664300.020318:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664300.020323:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.020367:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413daeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a7 expref: 8 pid: 9895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.020384:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413daeb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a7 expref: 8 pid: 9895 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664300.020421:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405328000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1875550140502272:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664300.020556:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406387600 going to sleep for 11 seconds 00000100:00100000:2.0:1788664300.025412:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664300.025839:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119431552 00000100:00100000:0.0:1788664300.025861:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119431552 00010000:00010000:0.0:1788664300.025915:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413daeb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a7 expref: 9 pid: 9895 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664300.025971:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:0.0:1788664300.025983:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c412c72850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2391:x1875550119431552:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664300.026006:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664300.026035:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413daeb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a7 expref: 9 pid: 9895 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.026052:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413daeb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a7 expref: 9 pid: 9895 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.026087:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664300.026092:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664300.026104:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.026115:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.026161:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664300.026828:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040b5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1875550140502400:192.168.203.52@tcp:105: 00000100:00100000:2.0:1788664300.027031:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42da4e480 going to sleep for 11 seconds 00010000:00010000:3.0:1788664300.028011:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413daeb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a7 expref: 9 pid: 9895 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664300.028038:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405328000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1875550140502272:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664300.028082:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.028098:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351ee600, rc 0) 00000100:00100000:3.0:1788664300.028168:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:11116:x1875550119431424:12345-192.168.203.52@tcp:101:bash.0 Request processed in 7958us (8235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664300.028732:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:2.0:1788664300.036259:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664300.036359:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119431808 00000100:00100000:1.0:1788664300.036371:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119431808 00000100:00100000:1.0:1788664300.036444:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788664300.036455:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:11116:x1875550119431808:12345-192.168.203.52@tcp:35:bash.0 00000001:00080000:1.0:1788664300.036815:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967314 00000100:00100000:1.0:1788664300.036991:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:11116:x1875550119431808:12345-192.168.203.52@tcp:35:bash.0 Request processed in 536us (748us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788664300.037000:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000020:00080000:1.0:1788664300.037006:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788664300.037911:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040b5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1875550140502400:192.168.203.52@tcp:105: 00010000:00010000:0.0:1788664300.037944:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664300.038002:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c412c72850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119431552:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 12020us (12606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664300.038014:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:1.0:1788664300.096238:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664300.100071:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140502528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664300.100200:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664300.100414:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140502528 00000100:00100000:3.0:1788664300.100425:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140502528 00000100:00100000:3.0:1788664300.100484:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788664300.100495:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140502528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664300.100545:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788664300.100622:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140502528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664300.100631:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788664300.100831:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140502528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664300.133308:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664300.133488:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119432064 00000100:00100000:1.0:1788664300.133503:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119432064 00000100:00100000:1.0:1788664300.133651:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:1.0:1788664300.133681:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:11126:x1875550119432064:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788664300.133717:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664300.133745:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413daf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d2b5 expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664300.133928:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788664300.134063:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413daf9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2b5 expref: 19 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.134080:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4350d0b00) 00010000:00010000:1.0:1788664300.134084:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788664300.134091:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413daf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2b5 expref: 19 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.134109:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b84a00, rc 0) 00000100:00100000:1.0:1788664300.134198:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:11126:x1875550119432064:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 519us (904us total) trans 4294967316 rc 301/301 00000100:00100000:1.0:1788664300.134207:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:1.0:1788664300.137547:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664300.137728:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119432320 00000100:00100000:2.0:1788664300.137740:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119432320 00000100:00100000:2.0:1788664300.137911:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788664300.137923:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:11126:x1875550119432320:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788664300.138515:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:11126:x1875550119432320:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 592us (978us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788664300.138524:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788664300.260926:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664300.263907:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119432448 00000100:00100000:3.0:1788664300.263930:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119432448 00000100:00100000:3.0:1788664300.264041:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:3.0:1788664300.264074:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:11132:x1875550119432448:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664300.264111:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664300.264142:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413db07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d2bc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.264237:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413db0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.264255:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413db0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.264273:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413db0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664300.264336:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788664300.264342:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788664300.264369:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413db0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.264404:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351efe00/0xcd11f61c1413db07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2bc expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.264441:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413db0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2bc expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.264463:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:3.0:1788664300.264466:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788664300.264471:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4351ef800, rc 0) 00000100:00100000:3.0:1788664300.264573:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:11132:x1875550119432448:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 501us (3663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664300.264591:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:0.0:1788664300.284257:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664300.284673:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119432704 00000100:00100000:1.0:1788664300.284687:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119432704 00000100:00100000:1.0:1788664300.284940:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:1.0:1788664300.284954:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:11132:x1875550119432704:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788664300.284986:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664300.285017:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413db15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d2c3 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.285217:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413db1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.285237:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413db1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.285252:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413db1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664300.285267:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788664300.285430:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413db15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2c3 expref: 23 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.285455:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413db1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2c3 expref: 22 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.285466:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785b00) 00010000:00010000:1.0:1788664300.285469:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788664300.285473:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b84a00, rc 0) 00000100:00100000:1.0:1788664300.285575:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:11132:x1875550119432704:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 624us (1335us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788664300.285584:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:1.0:1788664300.292039:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664300.292577:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119433088 00000100:00100000:3.0:1788664300.292592:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119433088 00000100:00100000:3.0:1788664300.292700:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1788664300.292712:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405319880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:2392:x1875550119433088:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664300.292739:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664300.292821:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413db1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2c3 expref: 22 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.292851:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785b00) 00010000:00010000:3.0:1788664300.292859:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664300.292932:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405319880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:2392:x1875550119433088:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 222us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664300.292941:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788664300.293166:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664300.293330:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119432960 00000100:00100000:1.0:1788664300.293345:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119432960 00000100:00100000:1.0:1788664300.293395:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:1.0:1788664300.293404:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:11132:x1875550119432960:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788664300.293451:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664300.293474:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413db2a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d2ca expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.293634:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413db31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.293652:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413db31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.293666:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413db31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664300.293680:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788664300.293855:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413db2a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ca expref: 24 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.293874:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413db31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ca expref: 23 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.293883:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785b00) 00010000:00010000:1.0:1788664300.293887:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788664300.293890:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b84600, rc 0) 00000100:00100000:1.0:1788664300.293942:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+23:11132:x1875550119432960:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 539us (777us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788664300.293950:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:2.0:1788664300.318191:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664300.319435:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119433216 00000100:00100000:3.0:1788664300.319449:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119433216 00000100:00100000:3.0:1788664300.319565:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:3.0:1788664300.319577:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119433216:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:3.0:1788664300.319632:0:9895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413db3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.319654:0:9895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.319664:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664300.319668:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664300.319687:0:9895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413db3f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.319736:0:9895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.319752:0:9895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 7 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664300.319767:0:9895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405328e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9895:1875550140502656:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664300.319903:0:9895:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406387600 going to sleep for 11 seconds 00000100:00100000:0.0:1788664300.331852:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664300.333009:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119433344 00000100:00100000:2.0:1788664300.333022:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119433344 00002000:00100000:2.0:1788664300.333069:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff93c3040b5500 x1875550119433344/t0(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:606/0 lens 504/0 e 0 to 0 dl 1788664311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664300.333081:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c3040b5500 with x1875550119433344 ext(0->12) 00010000:00010000:2.0:1788664300.333090:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 8 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.333127:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 8 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664300.333136:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c3040b5500 00000100:00100000:2.0:1788664300.333170:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1788664300.333181:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2390:x1875550119433344:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:1.0:1788664300.333645:0:9895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405328e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9895:1875550140502656:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664300.333671:0:9895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413db3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788664300.335547:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000100:00100000:2.0:1788664300.338382:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2390:x1875550119433344:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 5193us (6531us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788664300.338396:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00002000:00100000:2.0:1788664300.338408:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff93c3040b5500 x1875550119433344/t4294967300(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:606/0 lens 504/448 e 0 to 0 dl 1788664311 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664300.338418:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c3040b5500 with x1875550119433344 ext(0->12) 00010000:00010000:2.0:1788664300.338428:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 9 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.338447:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 9 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664300.338455:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c3040b5500 00000100:00100000:2.0:1788664300.352635:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664300.352847:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119433472 00000100:00100000:3.0:1788664300.352858:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119433472 00010000:00010000:3.0:1788664300.352900:0:10332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 9 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664300.352943:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:3.0:1788664300.352954:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2391:x1875550119433472:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664300.352969:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788664300.352986:0:10332:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788664300.352989:0:10332:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788664300 00002000:00010000:3.0:1788664300.352991:0:10332:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788664300 00002000:00010000:3.0:1788664300.352994:0:10332:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788664300 00002000:00010000:3.0:1788664300.352996:0:10332:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788664300.353002:0:10332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 9 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.353029:0:10332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 9 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.353053:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049ccda8f/0xcd11f61c1413daf2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ae expref: 9 pid: 8429 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.353071:0:10332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664300.353075:0:10332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664300.353080:0:10332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413db3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.353090:0:10332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413db3f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.353126:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664300.353183:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2391:x1875550119433472:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 231us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664300.353191:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00010000:00010000:1.0:1788664300.353953:0:9895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413db3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.353967:0:9895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413db3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.353992:0:9895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413db3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.354001:0:9895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413db3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.354009:0:9895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413db3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.354016:0:9895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351efe00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664300.354020:0:9895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413db3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.354028:0:9895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413db3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.354044:0:9895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413db3f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.354066:0:9895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a32463c/0xcd11f61c1413db3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664300.354132:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119433216:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 34558us (35957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664300.354140:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:2.0:1788664300.368650:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664300.369648:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119433728 00000100:00100000:3.0:1788664300.369660:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119433728 00000100:00100000:3.0:1788664300.369734:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788664300.369744:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+23:11132:x1875550119433728:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:3.0:1788664300.369942:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413db31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ca expref: 23 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788664300.370176:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788664300.370661:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:3.0:1788664300.371475:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00010000:00010000:3.0:1788664300.371522:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413db46 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.371539:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dad6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a0 expref: 27 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.371548:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413db46 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.371585:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dad6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a0 expref: 27 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.371600:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dad6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a0 expref: 27 pid: 9524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664300.371626:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405328a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6515:1875550140502784:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664300.373170:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406387f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788664300.378467:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664300.379398:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119433856 00000100:00100000:0.0:1788664300.379409:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119433856 00010000:00010000:0.0:1788664300.379452:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dad6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a0 expref: 28 pid: 9524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664300.379496:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:0.0:1788664300.379507:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405328e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+28:2390:x1875550119433856:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664300.379521:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664300.379528:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dad6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a0 expref: 28 pid: 9524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.379539:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dad6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a0 expref: 28 pid: 9524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.379563:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785b00) 00010000:00010000:0.0:1788664300.379569:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413db46 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.379592:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413db46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.379600:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413db46 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.379631:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664300.379703:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405328e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+28:2390:x1875550119433856:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 198us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664300.379711:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00010000:00010000:1.0:1788664300.382906:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dad6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2a0 expref: 27 pid: 9524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664300.382934:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405328a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6515:1875550140502784:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664300.382958:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413db46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.382969:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413db46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.382974:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413db46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788664300.383090:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000001:00080000:1.0:1788664300.383408:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1788664300.383502:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c40531ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1875550140502912:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788664300.383564:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664300.383670:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788664300.388096:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140502912 00000100:00100000:2.0:1788664300.388112:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140502912 00000100:00100000:0.0:1788664300.388415:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788664300.388427:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40531a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6515:x1875550140502912:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1788664300.388615:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664300.388726:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40531a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6515:x1875550140502912:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 301us (5161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664300.388736:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788664300.397082:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c40531ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1875550140502912:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788664300.398919:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000100:00100000:0.0:1788664300.399001:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1875550140503040:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788664300.399065:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664300.399094:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42da4eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788664300.399447:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140503040 00000100:00100000:3.0:1788664300.399456:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140503040 00000100:00100000:3.0:1788664300.399513:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788664300.399522:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1875550140503040:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788664300.399703:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6515:x1875550140503040:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 181us (637us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788664300.399726:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788664300.400003:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1875550140503040:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788664300.400065:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1788664300.400102:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413db46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.400112:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413db46 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.400121:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413db46 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.400127:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664300.400132:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413db46 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.400140:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413db46 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.400155:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785b00) 00010000:00010000:1.0:1788664300.400158:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788664300.400175:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413db46 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.400182:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413db46 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788664300.400293:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788664300.400550:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788664300.400562:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395537789989ns, next at 396537787812ns, rc = 0 00000001:00080000:1.0:1788664300.400569:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967327 00010000:00010000:1.0:1788664300.400593:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785b00) 00010000:00010000:1.0:1788664300.400597:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788664300.400622:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413db31 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ca expref: 31 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664300.400726:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+30:11132:x1875550119433728:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 30983us (32089us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788664300.400734:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000020:00080000:1.0:1788664300.400738:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788664300.403870:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664300.405176:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119433984 00000100:00100000:0.0:1788664300.405188:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119433984 00000100:00100000:0.0:1788664300.405277:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:0.0:1788664300.405288:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+30:11132:x1875550119433984:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664300.405322:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664300.405350:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413db4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d2d1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.405428:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413db4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2d1 expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.405443:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413db4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2d1 expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.405460:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:0.0:1788664300.405463:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664300.405466:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956600, rc 0) 00000100:00100000:0.0:1788664300.405537:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+31:11132:x1875550119433984:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 251us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664300.405544:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:3.0:1788664300.413702:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664300.413901:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119434240 00000100:00100000:2.0:1788664300.413911:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119434240 00000100:00100000:2.0:1788664300.413968:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1788664300.413978:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c406b63450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+31:11132:x1875550119434240:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788664300.415269:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c406b63450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+32:11132:x1875550119434240:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 1286us (1571us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788664300.415282:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1788664300.545490:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664300.545661:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119434496 00000100:00100000:0.0:1788664300.545677:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119434496 00000100:00100000:0.0:1788664300.545848:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:0.0:1788664300.545873:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+32:11142:x1875550119434496:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664300.545907:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664300.545933:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413db54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d2d8 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664300.546065:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788664300.546200:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413db54 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2d8 expref: 34 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.546218:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4350d0b00) 00010000:00010000:0.0:1788664300.546222:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788664300.546244:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413db54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2d8 expref: 34 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.546263:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957800, rc 0) 00000100:00100000:0.0:1788664300.546347:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+33:11142:x1875550119434496:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 489us (874us total) trans 4294967330 rc 301/301 00000100:00100000:0.0:1788664300.546355:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:3.0:1788664300.550323:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664300.550595:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119434624 00000100:00100000:2.0:1788664300.550616:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119434624 00000100:00100000:2.0:1788664300.550695:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:2.0:1788664300.550707:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+33:11142:x1875550119434624:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:2.0:1788664300.550989:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413db62 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.551013:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413db62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.551029:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413db62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.551044:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413db69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.551052:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413db69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.551059:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413db69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553185:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413db70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553223:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413db70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553234:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413db70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664300.553418:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413db70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553433:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413db62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553439:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413db62 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553446:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413db62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553453:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664300.553457:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413db62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553464:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413db62 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553476:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:2.0:1788664300.553479:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664300.553483:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413db62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553501:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413db62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553525:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413db69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553531:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413db69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553536:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413db69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553541:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0d600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664300.553544:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413db69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553550:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413db69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553557:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c404785f00) 00010000:00010000:2.0:1788664300.553559:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664300.553562:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413db69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553568:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413db69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553578:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413db70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553583:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413db70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553588:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413db70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553600:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0da00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664300.553614:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413db70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553620:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413db70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553628:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:2.0:1788664300.553630:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664300.553986:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413db70 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.553994:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413db70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664300.554095:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+33:11142:x1875550119434624:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 3386us (3786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664300.554105:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:3.0:1788664300.558638:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664300.558721:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119434880 00000100:00100000:1.0:1788664300.558731:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119434880 00000100:00100000:1.0:1788664300.558936:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1788664300.558947:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+33:11142:x1875550119434880:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788664300.561049:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+34:11142:x1875550119434880:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 2092us (2407us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788664300.561062:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1788664300.607175:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140503168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664300.607242:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664300.607492:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140503168 00000100:00100000:0.0:1788664300.607501:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140503168 00000100:00100000:0.0:1788664300.607562:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788664300.607572:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140503168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664300.607612:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664300.607671:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140503168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664300.607678:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788664300.607728:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140503168:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788664300.609847:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788664300.611975:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664300.612080:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119435136 00000100:00100000:3.0:1788664300.612094:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119435136 00000100:00100000:3.0:1788664300.612182:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:3.0:1788664300.612194:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+34:11145:x1875550119435136:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664300.612231:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664300.612261:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413db77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d2df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.612548:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413db7e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.612569:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413db7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.612583:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413db7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.612597:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413db85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.612614:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413db85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.612621:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413db85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.612970:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413db8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.612986:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413db8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.612994:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413db8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664300.613007:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788664300.613121:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413db7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.613129:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413db7e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.613137:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413db7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.613143:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664300.613148:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413db7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.613156:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413db7e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.613361:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:3.0:1788664300.613365:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664300.613373:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413db7e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664300.613517:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664300.613520:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140503424:0@lo:400:kworker.0 00000100:00100000:1.0:1788664300.613520:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140503296:0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.613554:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140503552:0@lo:400:kworker.0 00010000:00010000:3.0:1788664300.613619:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413db7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.613639:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413db85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.613645:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413db85 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.613650:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413db85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.613654:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664300.613657:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413db85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.613663:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413db85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.613672:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c404785f00) 00010000:00010000:3.0:1788664300.613675:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664300.613678:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413db85 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.613683:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413db85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.613750:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413db77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2df expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.613766:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413db8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2df expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.613836:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:3.0:1788664300.613839:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664300.613842:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502ba00, rc 0) 00000100:00100000:2.0:1788664300.618118:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664300.618118:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664300.618238:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140503296 00000100:00100000:1.0:1788664300.618251:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140503296 00000100:00100000:1.0:1788664300.618315:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788664300.618326:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140503296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664300.618419:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140503296:12345-0@lo:400:kworker.0 Request processed in 95us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664300.618428:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788664300.618431:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140503424 00000100:00100000:2.0:1788664300.618435:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140503424 00000100:00100000:2.0:1788664300.618467:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788664300.618474:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140503424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664300.618489:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140503296:0@lo:400:kworker.0 00000100:00100000:2.0:1788664300.618520:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140503424:12345-0@lo:400:kworker.0 Request processed in 47us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664300.618533:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788664300.618564:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140503424:0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.618837:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664300.618925:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140503552 00000100:00100000:1.0:1788664300.618932:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140503552 00000100:00100000:1.0:1788664300.618969:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788664300.618975:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140503552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664300.619036:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140503552:12345-0@lo:400:kworker.0 Request processed in 60us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664300.619045:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788664300.619076:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c402f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140503808:0@lo:400:kworker.0 00000100:00100000:1.0:1788664300.619115:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664300.619145:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c402f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140504320:0@lo:400:kworker.0 00000100:00100000:1.0:1788664300.619170:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664300.619187:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664300.619193:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c402f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140503936:0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.619315:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140503808 00000100:00100000:0.0:1788664300.619324:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140503808 00000100:00100000:0.0:1788664300.619375:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140504320 00000100:00100000:0.0:1788664300.619378:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140504320 00000100:00100000:0.0:1788664300.619399:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788664300.619409:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40531b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140503808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.619471:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40531b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140503808:12345-0@lo:400:kworker.0 Request processed in 65us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664300.619489:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788664300.619505:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788664300.619512:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40531b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140504320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.619544:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40531b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140504320:12345-0@lo:400:kworker.0 Request processed in 34us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664300.619550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788664300.619576:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c402f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140503680:0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.619711:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664300.619734:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c402f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140504192:0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.619756:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664300.619815:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140503552:0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.619835:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664300.619841:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c402f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140504064:0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.619867:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664300.619894:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140504064 00000100:00100000:0.0:1788664300.619897:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140504064 00000100:00100000:0.0:1788664300.620046:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788664300.620054:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140504064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.620093:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140504064:12345-0@lo:400:kworker.0 Request processed in 40us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664300.620099:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788664300.620362:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140503680 00000100:00100000:0.0:1788664300.620367:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140503680 00000100:00100000:0.0:1788664300.620381:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140504192 00000100:00100000:0.0:1788664300.620383:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140504192 00000100:00100000:0.0:1788664300.620407:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788664300.620413:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140503680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.620444:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140503680:12345-0@lo:400:kworker.0 Request processed in 32us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664300.620450:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788664300.620462:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788664300.620467:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140504192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.620491:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140504192:12345-0@lo:400:kworker.0 Request processed in 25us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664300.620497:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788664300.620524:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c402f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140504064:0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.620534:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c402f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140503680:0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.620541:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c402f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140504192:0@lo:400:kworker.0 00000100:00100000:1.0:1788664300.620678:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664300.620727:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140503936 00000100:00100000:0.0:1788664300.620734:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140503936 00010000:00080000:1.0:1788664300.620741:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c402f44380 x1875550140504320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664300.620757:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c402f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140504320:0@lo:400:kworker.0 00000100:00100000:1.0:1788664300.620798:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c402f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140503808:0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.620804:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788664300.620817:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140503936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.620860:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140503936:12345-0@lo:400:kworker.0 Request processed in 47us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664300.620871:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788664300.620878:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664300.620897:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c402f47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140504448:0@lo:400:kworker.0 00000100:00100000:1.0:1788664300.620938:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788664300.620984:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c402f44a80 x1875550140503936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664300.620994:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c402f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140503936:0@lo:400:kworker.0 00000100:00080000:2.0:1788664300.621042:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664300.621050:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788664300.621053:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664300.623304:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140504448 00000100:00100000:0.0:1788664300.623325:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140504448 00000100:00080000:2.0:1788664300.623429:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664300.623447:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788664300.623459:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40531aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140504448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664300.623591:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40531aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140504448:12345-0@lo:400:kworker.0 Request processed in 134us (2653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664300.623626:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788664300.623651:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c402f47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140504448:0@lo:400:kworker.0 00000100:00100000:3.0:1788664300.625976:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+36:11145:x1875550119435136:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 12558us (12791us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788664300.625995:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:3.0:1788664300.630661:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664300.631651:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119435264 00000100:00100000:0.0:1788664300.631667:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119435264 00000100:00100000:0.0:1788664300.631862:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:0.0:1788664300.631876:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+36:11145:x1875550119435264:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1788664300.631968:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413db9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.631991:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413db9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.632007:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413db9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.632051:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413db9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.632059:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413db9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.632066:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413db9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.632072:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957a00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664300.632078:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413db9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.632085:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413db9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.632098:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:0.0:1788664300.632118:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788664300.632125:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413db9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.632132:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413db9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664300.632304:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+36:11145:x1875550119435264:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 423us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664300.632313:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:0.0:1788664300.635407:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664300.635509:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119435520 00000100:00100000:2.0:1788664300.635522:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119435520 00000100:00100000:2.0:1788664300.635642:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788664300.635654:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+36:11145:x1875550119435520:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788664300.636190:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+37:11145:x1875550119435520:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 535us (794us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788664300.636200:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1788664300.929835:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664300.929964:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119435776 00000100:00100000:2.0:1788664300.929977:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119435776 00000100:00100000:2.0:1788664300.930066:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:2.0:1788664300.930078:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40531b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+37:11176:x1875550119435776:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:2.0:1788664300.930112:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664300.930139:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413dba1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d2e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.930281:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dba8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.930301:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dba8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.930338:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dba8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664300.930354:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788664300.930655:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413dba1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2e6 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.930678:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dba8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2e6 expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.930689:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:2.0:1788664300.930692:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664300.930697:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d600, rc 0) 00000100:00100000:2.0:1788664300.930853:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40531b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+39:11176:x1875550119435776:12345-192.168.203.52@tcp:101:cat.0 Request processed in 776us (1034us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788664300.930862:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:1.0:1788664300.943626:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664300.943992:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119436032 00000100:00100000:0.0:1788664300.944011:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119436032 00000100:00100000:0.0:1788664300.944090:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1788664300.944115:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+39:11176:x1875550119436032:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:0.0:1788664300.944913:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+40:11176:x1875550119436032:12345-192.168.203.52@tcp:35:cat.0 Request processed in 797us (1311us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788664300.944922:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1788664300.957075:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664300.957639:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119436160 00000100:00100000:2.0:1788664300.957650:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119436160 00000100:00100000:2.0:1788664300.957713:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1788664300.957724:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405319500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+40:2391:x1875550119436160:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664300.957741:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664300.957764:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dba8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2e6 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.957832:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:2.0:1788664300.957838:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664300.957911:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405319500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+39:2391:x1875550119436160:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 189us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664300.957921:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00010000:00010000:2.0:1788664300.991334:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664301.053329:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664301.055215:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119436416 00000100:00100000:3.0:1788664301.055230:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119436416 00000100:00100000:3.0:1788664301.055310:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:3.0:1788664301.055320:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+39:11183:x1875550119436416:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:3.0:1788664301.055345:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664301.055349:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788664301.055372:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef800/0xcd11f61c1413db0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2bc expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.055390:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:3.0:1788664301.055395:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664301.055416:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dbb6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d2ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.055517:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.055530:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413db8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2df expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.055555:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.055585:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413db8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2df expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.055605:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413db8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2df expref: 39 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664301.055620:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c40532fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875550140504576:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664301.055712:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406387f00 going to sleep for 11 seconds 00000100:00080000:2.0:1788664301.056366:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664301.059705:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664301.060021:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119436544 00000100:00100000:0.0:1788664301.060032:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119436544 00010000:00010000:0.0:1788664301.060084:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413db8c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2df expref: 40 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664301.060125:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:0.0:1788664301.060135:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40531ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+40:2391:x1875550119436544:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664301.060158:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664301.060166:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413db8c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2df expref: 40 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.060193:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413db8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2df expref: 40 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.060219:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:0.0:1788664301.060224:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.060233:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.060240:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.060260:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664301.060313:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40531ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+40:2391:x1875550119436544:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 179us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664301.060321:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00010000:00010000:3.0:1788664301.061080:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413db8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2df expref: 39 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664301.061099:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c40532fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875550140504576:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664301.061121:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.061131:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.061137:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664301.061164:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788664301.061309:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dbb6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ed expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.061339:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ed expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.061348:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:3.0:1788664301.061351:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788664301.061353:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502b800, rc 0) 00000100:00100000:3.0:1788664301.061393:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+39:11183:x1875550119436416:12345-192.168.203.52@tcp:101:dd.0 Request processed in 6074us (8071us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788664301.061400:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:1.0:1788664301.065899:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664301.066338:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119436672 00000100:00100000:0.0:1788664301.066348:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119436672 00000100:00100000:0.0:1788664301.066403:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:0.0:1788664301.066424:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+39:11183:x1875550119436672:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:0.0:1788664301.066449:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664301.066469:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413dbcb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d2f4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.066507:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413dbd2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.066538:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413dbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.066549:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413dbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.066683:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413dbcb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2f4 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.066702:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413dbd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2f4 expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.066710:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:0.0:1788664301.066713:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788664301.066729:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957e00, rc 0) 00000100:00100000:0.0:1788664301.066819:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+40:11183:x1875550119436672:12345-192.168.203.52@tcp:101:dd.0 Request processed in 408us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664301.066826:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:0.0:1788664301.071300:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664301.071399:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119436928 00000100:00100000:2.0:1788664301.071419:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119436928 00000100:00100000:2.0:1788664301.071481:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:2.0:1788664301.071493:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+40:11183:x1875550119436928:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:2.0:1788664301.071722:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dbd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664301.071740:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dbd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664301.071751:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dbd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664301.071860:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788664301.071892:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000308118fb reply state 00000000ec4bf24c transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dbd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664301.071906:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dbd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664301.071913:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:2.0:1788664301.071916:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788664301.071920:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788664301.072017:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+43:11183:x1875550119436928:12345-192.168.203.52@tcp:36:dd.0 Request processed in 525us (724us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788664301.072025:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000020:00080000:2.0:1788664301.072620:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788664301.118082:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664301.123071:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140504704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664301.123264:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664301.123468:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140504704 00000100:00100000:0.0:1788664301.123477:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140504704 00000100:00100000:0.0:1788664301.123529:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788664301.123538:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140504704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664301.123562:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664301.123622:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140504704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664301.123630:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788664301.123802:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140504704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664301.210070:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664301.210109:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664301.210151:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664301.210184:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664301.210211:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119437312 00000100:00100000:0.0:1788664301.210221:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119437312 00000100:00100000:0.0:1788664301.210272:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:0.0:1788664301.210282:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2390:x1875550119437312:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664301.210361:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2390:x1875550119437312:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 81us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664301.210368:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:0.0:1788664301.210410:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664301.210509:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119437184 00000100:00100000:0.0:1788664301.210513:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119437184 00000100:00080000:0.0:1788664301.210534:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788664301.210558:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119437440 00000100:00100000:0.0:1788664301.210561:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119437440 00000100:00080000:0.0:1788664301.210573:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664301.210581:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119437568 00000100:00100000:0.0:1788664301.210583:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119437568 00000100:00100000:0.0:1788664301.210617:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 314 00000100:00100000:0.0:1788664301.210624:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119437184:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664301.210659:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119437184:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664301.210666:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 314 00000100:00100000:0.0:1788664301.210678:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 315 00000100:00100000:0.0:1788664301.210683:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119437568:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664301.210723:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119437568:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 40us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664301.210729:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 315 00000100:00080000:0.0:1788664301.210743:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788664301.210761:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 316 00000100:00100000:0.0:1788664301.210768:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119437440:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664301.211330:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119437440:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 562us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664301.211337:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 316 00000100:00100000:2.0:1788664301.215820:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119437056 00000100:00100000:2.0:1788664301.215836:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119437056 00000100:00100000:2.0:1788664301.216214:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 386 00000100:00100000:2.0:1788664301.216226:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119437056:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664301.216319:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119437056:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 95us (6167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664301.216328:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 386 00000100:00100000:0.0:1788664301.365074:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664301.366395:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119437696 00000100:00100000:1.0:1788664301.366409:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119437696 00000100:00100000:1.0:1788664301.366485:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:1.0:1788664301.366496:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+43:11197:x1875550119437696:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:1.0:1788664301.366519:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664301.366539:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413dbe0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d2fb expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.366614:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dbe7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.366629:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dbe7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.366641:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dbe7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.366653:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dbee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.366676:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dbee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.366683:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dbee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.366764:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dbf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.366830:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ed expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.366839:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dbf5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.366886:0:9524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ed expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.366899:0:9524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ed expref: 44 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664301.366913:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f8a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9524:1875550140504832:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664301.367002:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788664301.369767:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664301.369900:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119437952 00000100:00100000:0.0:1788664301.369915:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119437952 00000100:00100000:0.0:1788664301.369984:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1788664301.369994:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+45:6161:x1875550119437952:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788664301.370313:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+46:6161:x1875550119437952:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 319us (559us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1788664301.370321:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1788664301.370692:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f8a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9524:1875550140504832:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664301.370716:0:9524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dbf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664301.378183:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664301.378477:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119438080 00000100:00100000:3.0:1788664301.378491:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119438080 00010000:00010000:3.0:1788664301.378543:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ed expref: 46 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664301.378593:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:3.0:1788664301.378614:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+46:2390:x1875550119438080:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664301.378634:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664301.378642:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ed expref: 46 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.378659:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ed expref: 46 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.378688:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dbbd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2ed expref: 46 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.378735:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:3.0:1788664301.378741:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dbf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.378753:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.378762:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dbf5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380232:0:9524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380266:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664301.380326:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788664301.380330:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664301.380373:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380388:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380398:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dbe7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380405:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dbe7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380412:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dbe7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380419:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664301.380424:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dbe7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.380426:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664301.380434:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dbe7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380454:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:1.0:1788664301.380458:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664301.380463:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dbe7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380482:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dbe7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380501:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dbee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380508:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dbee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380514:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dbee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380519:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664301.380522:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dbee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380528:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dbee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380537:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c404785f00) 00010000:00010000:1.0:1788664301.380541:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664301.380545:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dbee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380552:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dbee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664301.380588:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+46:2390:x1875550119438080:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 1968us (2421us total) trans 0 rc 0/0 00010000:00010000:1.0:1788664301.380592:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413dbe0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2fb expref: 46 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664301.380618:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00010000:00010000:1.0:1788664301.380630:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2fb expref: 45 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.380647:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:1.0:1788664301.380650:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788664301.380654:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b84e00, rc 0) 00000100:00100000:1.0:1788664301.380717:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+44:11197:x1875550119437696:12345-192.168.203.52@tcp:101:stat.0 Request processed in 14221us (15650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664301.380726:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:3.0:1788664301.466443:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664301.466545:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119438336 00000100:00100000:0.0:1788664301.466559:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119438336 00000100:00100000:0.0:1788664301.466707:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:0.0:1788664301.466721:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+44:11203:x1875550119438336:12345-192.168.203.52@tcp:36:truncate.0 00010000:00010000:0.0:1788664301.466846:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664301.466880:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dbf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2fb expref: 44 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.466926:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:0.0:1788664301.466932:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664301.467154:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413dbfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.467171:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413dbfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.467182:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413dbfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788664301.467231:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967340 00000004:00010000:0.0:1788664301.467254:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6a28d21 reply state 00000000343e34d6 transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413dbfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.467267:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413dbfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.467273:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:0.0:1788664301.467276:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788664301.467278:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788664301.467549:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+46:11203:x1875550119438336:12345-192.168.203.52@tcp:36:truncate.0 Request processed in 830us (1121us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788664301.467558:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000020:00080000:0.0:1788664301.467564:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788664301.631571:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664301.631614:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140504960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788664301.631715:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664301.631835:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140504960 00000100:00100000:3.0:1788664301.631863:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140504960 00000100:00100000:3.0:1788664301.631958:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788664301.631971:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140504960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788664301.632012:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1788664301.632114:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140504960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664301.632121:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788664301.632349:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140504960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788664301.663943:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664301.664043:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119438464 00000100:00100000:1.0:1788664301.664057:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119438464 00000100:00100000:1.0:1788664301.664132:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:1.0:1788664301.664145:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+46:11217:x1875550119438464:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:1.0:1788664301.664187:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664301.664214:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dc03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d302 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664301:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dc0a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664319:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dc0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664333:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dc0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664344:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dc11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664351:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dc11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664379:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dc11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664467:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dc18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664477:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dc18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664484:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dc18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664301.664534:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788664301.664540:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664301.664562:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dc18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664576:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dc18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664586:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dc0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664604:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dc0a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664612:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dc0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664619:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664301.664624:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dc0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664638:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dc0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664666:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:1.0:1788664301.664670:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664301.664676:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dc0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664683:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dc0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664698:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dc11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664704:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dc11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664710:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dc11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664715:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664301.664718:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dc11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664724:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dc11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664730:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c404785f00) 00010000:00010000:1.0:1788664301.664733:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664301.664736:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dc11 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664753:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dc11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664832:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dc03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d302 expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664848:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dc18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d302 expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.664857:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:1.0:1788664301.664860:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788664301.664863:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85200, rc 0) 00000100:00100000:1.0:1788664301.664945:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+47:11217:x1875550119438464:12345-192.168.203.52@tcp:101:stat.0 Request processed in 801us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664301.664955:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:1.0:1788664301.746618:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664301.746746:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119438720 00000100:00100000:0.0:1788664301.746760:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119438720 00000100:00100000:0.0:1788664301.746898:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:0.0:1788664301.746910:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+47:11227:x1875550119438720:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664301.746941:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664301.746970:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dc1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d309 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664301.747117:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788664301.747263:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dc1f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d309 expref: 49 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.747304:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4350d0b00) 00010000:00010000:0.0:1788664301.747309:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788664301.747316:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dc1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d309 expref: 49 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.747333:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956000, rc 0) 00000100:00100000:0.0:1788664301.747425:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+48:11227:x1875550119438720:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 516us (836us total) trans 4294967342 rc 301/301 00000100:00100000:0.0:1788664301.747433:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:3.0:1788664301.750882:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664301.750993:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119438976 00000100:00100000:0.0:1788664301.751006:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119438976 00000100:00100000:0.0:1788664301.751078:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1788664301.751090:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+48:11227:x1875550119438976:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788664301.751403:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+49:11227:x1875550119438976:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 315us (535us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788664301.751443:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000040:00080000:0.0:1788664301.823121:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788664301.826301:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788664301.833909:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664301.834323:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119439232 00000100:00100000:0.0:1788664301.834338:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119439232 00000100:00100000:0.0:1788664301.834642:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:0.0:1788664301.834658:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+49:11233:x1875550119439232:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788664301.834692:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664301.834720:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dc2d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d310 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.834908:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.834926:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dc18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d302 expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.834938:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.834981:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dc18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d302 expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.834997:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dc18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d302 expref: 50 pid: 6512 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664301.835015:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c402f47100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875550140505088:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788664301.835183:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42b0cc480 going to sleep for 11 seconds 00000100:00100000:0.0:1788664301.840094:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c402f47100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875550140505088:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788664301.840139:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664301.844667:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664301.847618:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119439360 00000100:00100000:1.0:1788664301.847641:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119439360 00010000:00010000:1.0:1788664301.847711:0:10332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dc18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d302 expref: 51 pid: 6512 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664301.847852:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:1.0:1788664301.847865:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c412c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+51:2391:x1875550119439360:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664301.847889:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664301.847897:0:10332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dc18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d302 expref: 51 pid: 6512 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.847937:0:10332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dc18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d302 expref: 51 pid: 6512 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.847968:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dc18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d302 expref: 51 pid: 6512 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.847988:0:10332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:1.0:1788664301.847995:0:10332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.848007:0:10332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.848017:0:10332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.848061:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664301.848146:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c412c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+50:2391:x1875550119439360:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 283us (3493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664301.848167:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00010000:00010000:3.0:1788664301.848743:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.848767:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664301.848821:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788664301.849000:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dc2d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d310 expref: 51 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.849020:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d310 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.849030:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:3.0:1788664301.849033:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788664301.849036:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957600, rc 0) 00000100:00100000:3.0:1788664301.849096:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+50:11233:x1875550119439232:12345-192.168.203.52@tcp:101:bash.0 Request processed in 14442us (15202us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788664301.849105:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:3.0:1788664301.853193:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664301.853518:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119439616 00000100:00100000:2.0:1788664301.853530:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119439616 00000100:00100000:3.0:1788664301.853708:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:3.0:1788664301.853721:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+50:11233:x1875550119439616:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:3.0:1788664301.854129:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dc42 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.854152:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dc42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.854326:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dc42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788664301.854389:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967345 00000004:00010000:3.0:1788664301.854424:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c4e9210 reply state 00000000c1a8d116 transno 4294967346 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dc42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.854439:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dc42 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.854447:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:3.0:1788664301.854450:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788664301.854454:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788664301.854612:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+53:11233:x1875550119439616:12345-192.168.203.52@tcp:36:bash.0 Request processed in 892us (1432us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788664301.854621:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000020:00080000:3.0:1788664301.854627:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788664301.861125:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664301.861362:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119439744 00000100:00100000:0.0:1788664301.861377:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119439744 00000100:00100000:0.0:1788664301.861600:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:0.0:1788664301.861615:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+53:11233:x1875550119439744:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788664301.861651:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664301.861678:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413dc49 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d317 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.861823:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dc50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.861852:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d310 expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.861862:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dc50 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.861907:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d310 expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.861923:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d310 expref: 54 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664301.861940:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c402f47100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140505216:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788664301.862057:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42b0cc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788664301.865032:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664301.865203:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119439872 00000100:00100000:1.0:1788664301.865216:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119439872 00010000:00010000:1.0:1788664301.865268:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d310 expref: 55 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664301.865322:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1788664301.865333:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+55:2390:x1875550119439872:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664301.865373:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664301.865381:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d310 expref: 55 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.865397:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d310 expref: 55 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.866003:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:1.0:1788664301.866013:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dc50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.866026:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dc50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.866036:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dc50 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664301.866062:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664301.866131:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+55:2390:x1875550119439872:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 799us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664301.866140:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00010000:00010000:0.0:1788664301.866715:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc34 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d310 expref: 54 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664301.866738:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c402f47100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140505216:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788664301.866766:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dc50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.866804:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dc50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.866811:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dc50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664301.866897:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788664301.866903:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788664301.866931:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dc50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.866972:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413dc49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d317 expref: 54 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.866988:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dc50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d317 expref: 53 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664301.866997:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:0.0:1788664301.867000:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664301.867003:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957000, rc 0) 00000100:00100000:0.0:1788664301.867052:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+53:11233:x1875550119439744:12345-192.168.203.52@tcp:101:bash.0 Request processed in 5442us (5945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664301.867062:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:2.0:1788664301.872054:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664301.872235:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119440128 00000100:00100000:0.0:1788664301.872251:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119440128 00000100:00100000:0.0:1788664301.872534:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:0.0:1788664301.872556:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c406b60050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+53:11233:x1875550119440128:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:0.0:1788664301.872933:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c406b60050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+54:11233:x1875550119440128:12345-192.168.203.52@tcp:35:bash.0 Request processed in 379us (894us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788664301.872942:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1788664301.960090:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664301.960805:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119440384 00000100:00100000:3.0:1788664301.960820:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119440384 00000100:00100000:3.0:1788664301.960985:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:3.0:1788664301.960998:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+54:11243:x1875550119440384:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664301.961036:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664301.961064:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dc57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d31e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664301.961355:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788664301.961564:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dc57 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d31e expref: 56 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.961584:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4350d0b00) 00010000:00010000:3.0:1788664301.961588:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664301.961621:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dc57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d31e expref: 56 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.961638:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502b000, rc 0) 00000100:00100000:3.0:1788664301.963399:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+55:11243:x1875550119440384:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2389us (3310us total) trans 4294967348 rc 301/301 00000100:00100000:3.0:1788664301.963427:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:2.0:1788664301.970360:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664301.972665:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119440512 00000100:00100000:3.0:1788664301.972689:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119440512 00000100:00100000:3.0:1788664301.972804:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:3.0:1788664301.972818:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+55:11243:x1875550119440512:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:3.0:1788664301.973135:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dc65 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973169:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dc65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973185:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dc65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973199:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dc6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973206:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dc6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973214:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dc6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973314:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dc73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973348:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dc73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973355:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dc73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664301.973420:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dc73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973436:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dc65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973443:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dc65 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973451:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dc65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973458:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664301.973464:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dc65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973473:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dc65 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973488:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:3.0:1788664301.973492:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664301.973498:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dc65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973506:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dc65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973529:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dc6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973762:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dc6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973877:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dc6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973885:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ba00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664301.973888:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dc6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973895:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dc6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973905:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c404785f00) 00010000:00010000:3.0:1788664301.973907:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664301.973911:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dc6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973917:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dc6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973931:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dc73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973936:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dc73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973942:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dc73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973955:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664301.973958:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dc73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973964:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dc73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973972:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:3.0:1788664301.973975:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664301.973978:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dc73 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664301.973983:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dc73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664301.974151:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+55:11243:x1875550119440512:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1334us (3803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664301.974169:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:0.0:1788664301.983647:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664301.983818:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119440768 00000100:00100000:2.0:1788664301.983833:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119440768 00000100:00100000:2.0:1788664301.983926:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788664301.983938:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+55:11243:x1875550119440768:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788664301.984268:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+56:11243:x1875550119440768:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 331us (635us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788664301.984277:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00010000:00010000:0.0:1788664302.014206:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664302.025859:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664302.026097:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119441024 00000100:00100000:0.0:1788664302.026111:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119441024 00000100:00100000:0.0:1788664302.026205:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:0.0:1788664302.026216:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+56:11246:x1875550119441024:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664302.026252:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664302.026290:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d325 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.026393:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc81 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.026413:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.026427:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.026439:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dc88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.026469:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dc88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.026478:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dc88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.026650:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413dc8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.026661:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413dc8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.026669:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413dc8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664302.026680:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788664302.026837:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.027374:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc81 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.027384:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.027391:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664302.027396:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.027405:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc81 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.027444:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:0.0:1788664302.027447:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664302.027454:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.027462:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.027481:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dc88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.027488:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dc88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.027493:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dc88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.027717:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664302.027720:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dc88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.027728:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dc88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.027738:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c404785f00) 00010000:00010000:0.0:1788664302.027741:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664302.027744:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dc88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.027750:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dc88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.028024:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dc7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d325 expref: 59 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.028043:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413dc8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d325 expref: 58 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.028051:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:0.0:1788664302.028053:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664302.028056:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957a00, rc 0) 00000100:00100000:0.0:1788664302.028221:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+58:11246:x1875550119441024:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2004us (2388us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788664302.028232:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:3.0:1788664302.033258:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664302.033438:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664302.033538:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119441280 00000100:00100000:1.0:1788664302.033551:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119441280 00000100:00100000:1.0:1788664302.033657:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788664302.033670:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+58:2390:x1875550119441280:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664302.033693:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664302.033751:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413dc8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d325 expref: 58 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664302.033809:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:1.0:1788664302.033817:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664302.033916:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+57:2390:x1875550119441280:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 247us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664302.033924:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1788664302.036145:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119441152 00000100:00100000:0.0:1788664302.036239:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119441152 00000100:00100000:0.0:1788664302.036474:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:0.0:1788664302.036487:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+57:11246:x1875550119441152:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1788664302.036608:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.036634:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.036649:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.036696:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.036724:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.036732:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.036739:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664302.036744:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.036753:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.036766:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:0.0:1788664302.036811:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788664302.036817:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.036825:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413dc9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664302.036962:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+57:11246:x1875550119441152:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 477us (3718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664302.036972:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:1.0:1788664302.040887:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664302.041275:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119441536 00000100:00100000:3.0:1788664302.041288:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119441536 00000100:00100000:3.0:1788664302.041362:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788664302.041374:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+57:11246:x1875550119441536:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788664302.042042:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+58:11246:x1875550119441536:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 664us (1170us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788664302.042055:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1788664302.142147:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788664302.142191:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c40532df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140505344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664302.142304:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664302.145427:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140505344 00000100:00100000:1.0:1788664302.145454:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140505344 00000100:00100000:1.0:1788664302.145573:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788664302.145598:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140505344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788664302.145646:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788664302.145794:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140505344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 189us (3468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664302.145803:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1788664302.146316:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664302.146399:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664302.146425:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c402f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140505472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664302.146517:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788664302.146643:0:8690:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 397283870045ns, next at 398283866070ns, rc = 0 00000100:00100000:3.0:1788664302.146853:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140505472 00000100:00100000:3.0:1788664302.146874:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140505472 00000100:00100000:3.0:1788664302.146943:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788664302.146954:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875550140505472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788664302.146976:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788664302.147021:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875550140505472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664302.147029:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1788664302.148303:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664302.155005:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c40532df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140505344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788664302.160649:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c402f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140505472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664302.226103:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664302.227059:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119441792 00000100:00100000:1.0:1788664302.227080:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119441792 00000100:00100000:1.0:1788664302.227174:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:1.0:1788664302.227187:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+58:11264:x1875550119441792:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:1.0:1788664302.227224:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664302.227253:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413dca4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d32c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.236233:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dcab lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.236267:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dcab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.236571:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dcab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664302.236601:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788664302.236809:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413dca4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d32c expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.237968:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dcab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d32c expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.237984:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:2.0:1788664302.237987:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788664302.237991:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0ce00, rc 0) 00000100:00100000:2.0:1788664302.238608:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+60:11264:x1875550119441792:12345-192.168.203.52@tcp:101:cat.0 Request processed in 11421us (12520us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788664302.238618:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:1.0:1788664302.271005:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664302.271632:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119441920 00000100:00100000:2.0:1788664302.271647:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119441920 00000100:00100000:2.0:1788664302.271731:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:2.0:1788664302.271743:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+60:11265:x1875550119441920:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664302.271821:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664302.271880:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dcb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d333 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.271976:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413dcc0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.271992:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413dcc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.272004:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413dcc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664302.272057:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788664302.272062:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664302.272086:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413dcc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.272116:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dcb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d333 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.272139:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413dcc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d333 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.272146:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:2.0:1788664302.272148:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664302.272212:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0da00, rc 0) 00000100:00100000:2.0:1788664302.272393:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:11265:x1875550119441920:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 651us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664302.272411:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:1.0:1788664302.280315:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664302.280573:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119442304 00000100:00100000:0.0:1788664302.280588:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119442304 00000100:00100000:0.0:1788664302.280972:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1788664302.281000:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:11265:x1875550119442304:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788664302.284151:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+62:11265:x1875550119442304:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 3154us (3842us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788664302.284166:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788664302.288416:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664302.288574:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119442432 00000100:00100000:1.0:1788664302.288596:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119442432 00000100:00100000:1.0:1788664302.288663:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788664302.288674:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+62:11265:x1875550119442432:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:1.0:1788664302.288690:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788664302.288713:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dc50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d317 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664302.288737:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dcab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d32c expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664302.288750:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413db4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2d1 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664302.288761:0:10332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:1.0:1788664302.288767:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664302.288874:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:11265:x1875550119442432:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 202us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664302.288882:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788664302.293050:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664302.293142:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119442560 00000100:00100000:0.0:1788664302.293159:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119442560 00000100:00100000:0.0:1788664302.293219:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:0.0:1788664302.293230:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:11265:x1875550119442560:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:0.0:1788664302.293346:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dcc7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.293365:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dcc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.293377:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dcc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788664302.294332:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788664302.294542:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788664302.294654:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788664302.294742:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:11265:x1875550119442560:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 1512us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664302.294752:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:0.0:1788664302.320468:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664302.320680:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119442688 00000100:00100000:2.0:1788664302.320699:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119442688 00000100:00100000:2.0:1788664302.320918:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:2.0:1788664302.320933:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:11267:x1875550119442688:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664302.320967:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664302.320998:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dcce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d33a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321092:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dcd5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321112:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dcd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321125:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dcd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321155:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dcdc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321164:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dcdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321170:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dcdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321266:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dce3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321277:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dce3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321308:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dce3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664302.321362:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788664302.321367:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664302.321388:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dce3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321410:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dce3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321419:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dcd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321426:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dcd5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321433:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dcd5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321439:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664302.321444:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dcd5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321452:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dcd5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321466:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:2.0:1788664302.321470:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664302.321476:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dcd5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321494:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dcd5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321510:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dcdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321516:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dcdc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321532:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dcdc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321537:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ce00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664302.321541:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dcdc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321547:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dcdc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321554:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c404785f00) 00010000:00010000:2.0:1788664302.321556:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664302.321559:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dcdc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321565:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dcdc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321605:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dcce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d33a expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321619:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dce3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d33a expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.321633:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:2.0:1788664302.321636:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664302.321638:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d200, rc 0) 00000100:00100000:2.0:1788664302.321718:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+60:11267:x1875550119442688:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 788us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664302.321726:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00000040:00080000:2.0:1788664302.846468:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664302.846479:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664302.846534:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788664302.846545:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788664302.846745:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041ce680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1875550140505600:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788664302.851093:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412c5f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788664302.862977:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664302.865001:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041ce680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1875550140505600:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788664302.865641:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119442816 00000100:00100000:2.0:1788664302.865651:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119442816 00000100:00100000:2.0:1788664302.865716:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:2.0:1788664302.865726:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+60:11278:x1875550119442816:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788664302.865758:0:6511:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788664302.866715:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+60:11278:x1875550119442816:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 986us (3745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664302.866725:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000001:00080000:2.0:1788664302.868510:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1788664302.868524:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1788664302.868576:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788664302.868594:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c42da4e840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788664302.868599:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c40479d900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c42da4ee40 00000020:00080000:2.0:1788664302.868602:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c40479de00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c30398d400 00000020:00080000:1.0:1788664302.869357:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788664302.869517:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788664302.869528:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664302.869547:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f8a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140505728:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788664302.869622:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664302.869674:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140505728 00000100:00100000:1.0:1788664302.869681:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140505728 00000100:00100000:1.0:1788664302.869724:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788664302.869733:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1875550140505728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788664302.869761:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1788664302.869818:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9cd9ec, atime: 0x6a9cd9ec, ctime: 0x6a9cd9ec, blocks: 0x8 00010000:00010000:1.0:1788664302.869826:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413dcea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664302.869843:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1788664302.869847:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664302.869853:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413dcea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664302.869868:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413dcea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664302.869879:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413dcea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664302.869887:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413dcea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664302.869905:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788664302.870012:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1875550140505728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 280us (390us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788664302.870019:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788664302.870050:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664302.870056:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413dcea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664302.870063:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85c00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664302.870067:0:7453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413dcea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664302.870076:0:7453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413dcea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664302.870090:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413dcea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664302.870097:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413dcea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664302.870113:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664302.870114:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664302.870116:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788664302.870141:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c43f8a8a80/2, rc 0, transno 4294967302 00010000:00010000:0.0:1788664302.871916:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413da89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.871945:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413da89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.871952:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413da89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.871957:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ef400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664302.871962:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413da89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.871970:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413da89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.871988:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93c4350d0f00) 00010000:00010000:0.0:1788664302.871992:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664302.871997:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413da89 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872003:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef400/0xcd11f61c1413da89 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872023:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413da90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872029:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413da90 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872034:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413da90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872039:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ee000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664302.872048:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413da90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872054:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413da90 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872062:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:0.0:1788664302.872065:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664302.872068:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413da90 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872074:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee000/0xcd11f61c1413da90 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872103:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dacf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872110:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dacf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872115:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dacf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872120:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664302.872123:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dacf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872129:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dacf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872136:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c404785f00) 00010000:00010000:0.0:1788664302.872139:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664302.872159:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dacf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872165:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dacf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872181:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dbd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872187:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dbd9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872191:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dbd9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872196:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0d600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664302.872199:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dbd9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872204:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dbd9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872213:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:0.0:1788664302.872214:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664302.872217:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dbd9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872222:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dbd9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872231:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413dbfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872236:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413dbfc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872247:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413dbfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872252:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664302.872255:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413dbfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872261:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413dbfc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872269:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:0.0:1788664302.872272:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664302.872285:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413dbfc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872291:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413dbfc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872303:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dc42 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872308:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dc42 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872313:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dc42 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872317:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664302.872320:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dc42 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872344:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dc42 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872354:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:0.0:1788664302.872356:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664302.872359:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dc42 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.872364:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413dc42 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664302.874305:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f8a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140505728:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788664302.887576:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664302.887631:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119442944 00000100:00100000:0.0:1788664302.887643:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119442944 00000100:00100000:0.0:1788664302.887697:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:0.0:1788664302.887707:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+12:11278:x1875550119442944:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788664302.887813:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dcf1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.887831:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dcf1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.888930:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dcf1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.888997:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dcf8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.889007:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dcf8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.889029:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dcf8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.889057:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dcff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.889064:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dcff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.889071:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dcff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664302.889122:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788664302.889126:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788664302.889141:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dcff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.890063:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dcf1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.890071:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dcf1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.890078:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dcf1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.890083:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664302.890087:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dcf1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.890094:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dcf1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.890115:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c4350d6600) 00010000:00010000:0.0:1788664302.890118:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664302.890123:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dcf1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.890129:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413dcf1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.890141:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dcf8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.890933:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dcf8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.890940:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dcf8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.890945:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664302.890948:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dcf8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.890956:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dcf8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.890966:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff93c303886500) 00010000:00010000:0.0:1788664302.890968:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664302.890971:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dcf8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.890978:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413dcf8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.891009:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dcff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.891015:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dcff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.891020:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dcff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.891024:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664302.891027:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dcff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.891033:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dcff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.891040:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:0.0:1788664302.891042:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664302.891045:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dcff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.891051:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dcff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664302.895440:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+12:11278:x1875550119442944:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 3439us (3575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664302.895458:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:1.0:1788664302.899055:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664302.899141:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119443200 00000100:00100000:0.0:1788664302.899152:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119443200 00000100:00100000:0.0:1788664302.899213:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:0.0:1788664302.899234:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+12:11278:x1875550119443200:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664302.899255:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664302.899285:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413dd06 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d341 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.899408:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dd0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.899424:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dd0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.899436:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dd0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664302.899448:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788664302.899534:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dd0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.899541:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dd0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.899548:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dd0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.899554:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664302.899560:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dd0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.899568:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dd0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.899580:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:0.0:1788664302.899602:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664302.899608:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dd0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.899614:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413dd0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.899652:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413dd06 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d341 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.899662:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c4350d6600) 00010000:00010000:0.0:1788664302.899664:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788664302.899668:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413dd06 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d341 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664302.899679:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956600, rc 0) 00000100:00100000:0.0:1788664302.899740:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:11278:x1875550119443200:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 507us (692us total) trans 4294967354 rc 301/301 00000100:00100000:0.0:1788664302.899748:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:2.0:1788664302.903487:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664302.903566:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119443328 00000100:00100000:0.0:1788664302.903575:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119443328 00000100:00100000:0.0:1788664302.903645:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:0.0:1788664302.903655:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:11278:x1875550119443328:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788664302.903690:0:9524:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788664302.903984:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:11278:x1875550119443328:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 329us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664302.903993:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:0.0:1788664302.913453:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664302.913650:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119443584 00000100:00100000:1.0:1788664302.913661:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119443584 00000100:00100000:1.0:1788664302.913733:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:1.0:1788664302.913746:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:11278:x1875550119443584:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664302.913792:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664302.913795:0:9169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788664302.913823:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413dcc0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d333 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664302.913842:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:1.0:1788664302.913847:0:9169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664302.913860:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dd1b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d348 expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788664302.916809:0:9169:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788664302.917269:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dd22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.917764:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dd22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.917797:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dd22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.917872:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413dd1b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d348 expref: 15 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.917892:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dd22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d348 expref: 14 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.917900:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:3.0:1788664302.917903:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664302.917917:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502ba00, rc 0) 00000100:00100000:3.0:1788664302.917994:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:11278:x1875550119443584:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 4251us (4549us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788664302.918003:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:0.0:1788664302.936576:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664302.937658:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119443840 00000100:00100000:3.0:1788664302.937739:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119443840 00000100:00100000:3.0:1788664302.937978:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:3.0:1788664302.937989:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:11278:x1875550119443840:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788664302.938047:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664302.938074:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dd22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d348 expref: 14 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938089:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:3.0:1788664302.938098:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664302.938136:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd30 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938161:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd30 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938174:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd30 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938237:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x75e5c707 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938245:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x75e5c707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938251:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x75e5c707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938315:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd30 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938322:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd30 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938328:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd30 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938341:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664302.938345:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd30 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938352:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd30 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938361:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:3.0:1788664302.938364:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664302.938368:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd30 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938374:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd30 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938382:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x75e5c707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938388:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd37 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x75e5c707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938393:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x75e5c707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938403:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664302.938406:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x75e5c707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938412:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd37 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x75e5c707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938420:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x75e5c707 (ffff93c4350d0600) 00010000:00010000:3.0:1788664302.938423:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664302.938425:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd37 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x75e5c707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.938431:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd37 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x75e5c707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664302.938524:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:11278:x1875550119443840:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 537us (1957us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788664302.938531:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:0.0:1788664302.946229:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664302.946992:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119443968 00000100:00100000:2.0:1788664302.947002:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119443968 00000100:00100000:2.0:1788664302.947412:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:2.0:1788664302.947424:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:11278:x1875550119443968:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664302.947447:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664302.947756:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413dd3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d34f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.948073:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dd45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.948098:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dd45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.948109:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dd45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.948951:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413dd3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d34f expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.948971:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dd45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d34f expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.948980:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93c3038d3b00) 00010000:00010000:2.0:1788664302.948983:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788664302.948987:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c400, rc 0) 00000100:00100000:2.0:1788664302.949108:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:11278:x1875550119443968:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1686us (2888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664302.949125:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:2.0:1788664302.976451:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664302.976627:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119444224 00000100:00100000:3.0:1788664302.976638:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119444224 00000100:00100000:3.0:1788664302.976704:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:3.0:1788664302.976714:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:11278:x1875550119444224:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788664302.976823:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.977003:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.977017:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788664302.977256:0:9169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1788664302.977267:0:9169:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398114495317ns, next at 399114492666ns, rc = 0 00000004:00010000:2.0:1788664302.977315:0:9169:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fe82db0 reply state 00000000bd8d2b0a transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.977329:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664302.977337:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93c3038d3b00) 00010000:00010000:2.0:1788664302.977340:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788664302.977343:0:9169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788664302.977444:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+16:11278:x1875550119444224:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 729us (1001us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1788664302.977452:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:0.0:1788664302.985062:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664302.985160:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119444352 00000100:00100000:3.0:1788664302.985170:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119444352 00000100:00100000:3.0:1788664302.985226:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:3.0:1788664302.985237:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+16:11278:x1875550119444352:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664302.985261:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664302.985292:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.985352:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d356 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.985366:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d356 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664302.985384:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93c3038d3b00) 00010000:00010000:3.0:1788664302.985387:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664302.985391:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502b400, rc 0) 00000100:00100000:3.0:1788664302.985457:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:11278:x1875550119444352:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 221us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664302.985464:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:3.0:1788664302.996027:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664302.996242:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119444480 00000100:00100000:1.0:1788664302.996252:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119444480 00000100:00100000:1.0:1788664302.996295:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:1.0:1788664302.996303:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1875550119444480:12345-192.168.203.52@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788664302.996338:0:8428:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:1.0:1788664302.996368:0:8428:0:(genops.c:1385:class_connect()) connect: client b07edea8-5696-4cd5-9a12-cefd3a8358e9, cookie 0xcd11f61c1413dd5a 00002000:00100000:1.0:1788664302.996380:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b07edea8-5696-4cd5-9a12-cefd3a8358e9/ffff93c3041b1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788664302.996398:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788664302.996472:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788664302.996503:0:8428:0:(import.c:65:import_set_state_nolock()) ffff93c3041b3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664302.996571:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2389:x1875550119444480:12345-192.168.203.52@tcp:8:lhsmtool_posix.0 Request processed in 267us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664302.996579:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1788664302.998689:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664302.998766:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119444608 00000100:00100000:1.0:1788664302.998810:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119444608 00000100:00100000:1.0:1788664302.998984:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1788664302.999001:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:0:x1875550119444608:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788664302.999188:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788664303.007740:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:1.0:1788664303.007755:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000100:00100000:3.0:1788664303.008031:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:0:x1875550119444608:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 9026us (9343us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788664303.008043:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:0.0:1788664303.011265:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664303.011663:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119444864 00000100:00100000:3.0:1788664303.011746:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119444864 00000100:00100000:3.0:1788664303.011851:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788664303.011862:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:11278:x1875550119444864:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788664303.012077:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:11278:x1875550119444864:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 217us (818us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788664303.012085:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00080000:0.0:1788664303.012259:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664303.018530:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664303.018809:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119445120 00000100:00100000:0.0:1788664303.018819:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119445120 00000100:00100000:0.0:1788664303.018993:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:0.0:1788664303.019003:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:11278:x1875550119445120:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788664303.019111:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:11278:x1875550119445120:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 110us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664303.019224:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:1.0:1788664303.025522:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664303.031512:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119445248 00000100:00100000:2.0:1788664303.031526:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119445248 00000100:00100000:2.0:1788664303.033410:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:2.0:1788664303.033429:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:11278:x1875550119445248:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664303.033452:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664303.033476:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dd61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d35d expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.033547:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dd68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.033570:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dd68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.033581:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dd68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664303.033639:0:9169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664303.033659:0:9169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dd68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.033684:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413dd61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d35d expref: 20 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.033702:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dd68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d35d expref: 19 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.033711:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93c3038d3b00) 00010000:00010000:2.0:1788664303.033714:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788664303.033718:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0ce00, rc 0) 00000100:00100000:2.0:1788664303.033811:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:11278:x1875550119445248:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 389us (8294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664303.033819:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 88 00010000:00010000:2.0:1788664303.038956:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664303.042074:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664303.042758:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119445376 00000100:00100000:0.0:1788664303.043043:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119445376 00000100:00100000:0.0:1788664303.043131:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788664303.043151:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119445376:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664303.043169:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664303.043190:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db73f06c/0xcd11f61c1413dd6f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d364 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788664303.043215:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cd9ee, blocks: 0x0 00010000:00010000:0.0:1788664303.043234:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:0.0:1788664303.043238:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664303.043248:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db73f06c/0xcd11f61c1413dd6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d364 expref: 6 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.043268:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db73f06c/0xcd11f61c1413dd6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d364 expref: 6 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.043301:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956400, rc 0) 00000100:00100000:0.0:1788664303.043367:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119445376:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 227us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664303.043375:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:2.0:1788664303.048681:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664303.048751:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119445632 00000100:00100000:0.0:1788664303.048760:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119445632 00000100:00100000:1.0:1788664303.048960:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:1.0:1788664303.048972:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:11278:x1875550119445632:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788664303.049084:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:11278:x1875550119445632:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 114us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664303.049092:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:1.0:1788664303.053688:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664303.053965:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119445760 00000100:00100000:3.0:1788664303.053978:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119445760 00000100:00100000:3.0:1788664303.054044:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:3.0:1788664303.054055:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:11278:x1875550119445760:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664303.054077:0:9895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664303.054104:0:9895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413dd76 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d36b expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.054136:0:9895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db73f06c/0xcd11f61c1413dd6f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d364 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.054145:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664303.054159:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664303.054165:0:9895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413dd76 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d36b expref: 7 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.054199:0:9895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db73f06c/0xcd11f61c1413dd6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d364 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.054235:0:9895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db73f06c/0xcd11f61c1413dd6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d364 expref: 7 pid: 8428 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664303.054249:0:9895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c40532ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9895:1875550140505856:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664303.054352:0:9895:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403067480 going to sleep for 11 seconds 00000100:00100000:3.0:1788664303.058682:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664303.058850:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119445888 00000100:00100000:0.0:1788664303.058860:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119445888 00010000:00010000:0.0:1788664303.058900:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db73f06c/0xcd11f61c1413dd6f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d364 expref: 8 pid: 8428 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664303.058938:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1788664303.058946:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2391:x1875550119445888:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664303.058960:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664303.058981:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db73f06c/0xcd11f61c1413dd6f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d364 expref: 8 pid: 8428 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.058995:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db73f06c/0xcd11f61c1413dd6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d364 expref: 8 pid: 8428 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.059019:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664303.059023:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664303.059032:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413dd76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d36b expref: 8 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.059062:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413dd76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d36b expref: 8 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.059098:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413dd76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d36b expref: 8 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664303.059113:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304095500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1875550140505984:192.168.203.52@tcp:105: 00000100:00100000:0.0:1788664303.059205:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411902cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1788664303.059987:0:9895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db73f06c/0xcd11f61c1413dd6f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d364 expref: 8 pid: 8428 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664303.060002:0:9895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c40532ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9895:1875550140505856:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664303.060024:0:9895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413dd76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d36b expref: 7 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.060035:0:9895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a400, rc 0) 00000100:00100000:1.0:1788664303.060080:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:11278:x1875550119445760:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 6026us (6413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664303.060088:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:3.0:1788664303.067016:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664303.067128:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119446016 00000100:00100000:1.0:1788664303.067138:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119446016 00002000:00100000:1.0:1788664303.067192:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff93c40532ca80 x1875550119446016/t0(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:609/0 lens 504/0 e 0 to 0 dl 1788664314 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788664303.067221:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c40532ca80 with x1875550119446016 ext(0->8) 00002000:00010000:1.0:1788664303.067227:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c40532ca80 00000100:00100000:1.0:1788664303.067255:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1788664303.067264:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2390:x1875550119446016:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788664303.067997:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304095500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1875550140505984:192.168.203.52@tcp:105: 00010000:00010000:0.0:1788664303.068021:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664303.068072:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2391:x1875550119445888:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 9126us (9409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664303.068081:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1788664303.069160:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2390:x1875550119446016:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 1892us (2148us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788664303.069176:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00002000:00100000:0.0:1788664303.069186:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff93c40532ca80 x1875550119446016/t4294967303(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:609/0 lens 504/448 e 0 to 0 dl 1788664314 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788664303.069196:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c40532ca80 with x1875550119446016 ext(0->8) 00002000:00010000:0.0:1788664303.069201:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c40532ca80 00000100:00100000:3.0:1788664303.073453:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664303.073678:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119446144 00000100:00100000:0.0:1788664303.073688:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119446144 00000100:00100000:0.0:1788664303.073748:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:0.0:1788664303.073758:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:11278:x1875550119446144:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788664303.076375:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000004:00080000:2.0:1788664303.076390:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:0.0:1788664303.076480:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.076492:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.076500:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.076507:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664303.076511:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.076519:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.076536:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93c3038d3b00) 00010000:00010000:0.0:1788664303.076539:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788664303.076544:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd4c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.076551:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413dd4c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664303.077411:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c40532e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140506112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788664303.077482:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788664303.077652:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1788664303.077803:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140506112 00000100:00100000:0.0:1788664303.077812:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140506112 00000100:00100000:0.0:1788664303.077976:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788664303.077985:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140506112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788664303.078109:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788664303.078113:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788664303 00002000:00010000:0.0:1788664303.078115:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788664303.078129:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788664302 -> 1788664303 00002000:00010000:0.0:1788664303.078132:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00080000:2.0:1788664303.078444:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664303.078498:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1875550140506112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 513us (1015us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788664303.078506:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788664303.078627:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:11278:x1875550119446144:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 4869us (5182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664303.078636:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00000004:00080000:1.0:1788664303.083873:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c40532e300/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788664303.083889:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c40532e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140506112:0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1788664303.083920:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788664303.083933:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788664303.084172:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664303.084397:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119446272 00000100:00100000:1.0:1788664303.084404:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119446272 00000100:00100000:1.0:1788664303.084462:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:1.0:1788664303.084472:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2393:x1875550119446272:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788664303.086399:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1788664303.086409:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788664303.086568:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2393:x1875550119446272:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 2092us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664303.086579:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:3.0:1788664303.101253:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664303.101407:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119446528 00000100:00100000:1.0:1788664303.101417:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119446528 00000100:00100000:1.0:1788664303.101473:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:1.0:1788664303.101484:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:11278:x1875550119446528:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788664303.101534:0:9169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664303.101560:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dd68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d35d expref: 14 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.101611:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93c3038d3b00) 00010000:00010000:1.0:1788664303.101617:0:9169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664303.101646:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dd7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.101659:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dd7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.101680:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dd7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788664303.101849:0:9169:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3122acf reply state 0000000059b80c78 transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dd7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.101862:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dd7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.101869:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93c3038d3b00) 00010000:00010000:1.0:1788664303.101872:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788664303.101874:0:9169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788664303.101965:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:11278:x1875550119446528:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 482us (720us total) trans 4294967358 rc 0/0 00000100:00100000:1.0:1788664303.101973:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:3.0:1788664303.105641:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664303.105897:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119446656 00000100:00100000:0.0:1788664303.105907:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119446656 00000100:00100000:0.0:1788664303.105956:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:0.0:1788664303.105965:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119446656:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788664303.106119:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788664303.106123:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788664303 -> 1788664301 00002000:00010000:0.0:1788664303.106125:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788664300 00002000:00010000:0.0:1788664303.106127:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788664303 -> 1788664301 00002000:00010000:0.0:1788664303.106129:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788664303.106203:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119446656:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 238us (571us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788664303.106211:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1788664303.114651:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664303.115197:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119446912 00000100:00100000:2.0:1788664303.115208:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119446912 00000100:00100000:2.0:1788664303.115271:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:2.0:1788664303.115289:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:11278:x1875550119446912:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788664303.115357:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dd84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.115374:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dd45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d34f expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.115384:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dd84 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.115419:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dd45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d34f expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.115432:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dd45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d34f expref: 15 pid: 6513 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664303.115447:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875550140506240:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664303.115538:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412c5f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664303.119834:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664303.119919:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875550140506240:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788664303.119945:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dd84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664303.121728:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119447040 00000100:00100000:3.0:1788664303.121742:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119447040 00010000:00010000:3.0:1788664303.121809:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dd45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d34f expref: 16 pid: 6513 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664303.121858:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:3.0:1788664303.121869:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+16:2390:x1875550119447040:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664303.121884:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664303.121891:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dd45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d34f expref: 16 pid: 6513 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.121905:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dd45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d34f expref: 16 pid: 6513 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.121930:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413dd45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d34f expref: 16 pid: 6513 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.121955:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93c3038d3b00) 00010000:00010000:3.0:1788664303.121961:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dd84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.121971:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dd84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.121979:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dd84 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.122001:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664303.122058:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:2390:x1875550119447040:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 190us (2231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664303.122066:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00010000:00010000:2.0:1788664303.122182:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dd84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.122201:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dd84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.122992:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dd84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.123003:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dd84 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.123010:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dd84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.123016:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664303.123020:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dd84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.123026:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dd84 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.123050:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93c3038d3b00) 00010000:00010000:3.0:1788664303.123053:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788664303.123058:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dd84 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.123064:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dd84 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664303.123124:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:11278:x1875550119446912:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 7835us (8480us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788664303.123134:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:3.0:1788664303.129118:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664303.129170:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119447168 00000100:00100000:3.0:1788664303.129179:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119447168 00000100:00100000:3.0:1788664303.129229:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:3.0:1788664303.129238:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2390:x1875550119447168:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788664303.129400:0:9895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413dd8b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.129422:0:9895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413dd76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d36b expref: 7 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.129431:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664303.129435:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664303.129440:0:9895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413dd8b lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.129485:0:9895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413dd76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d36b expref: 7 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.129500:0:9895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413dd76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d36b expref: 7 pid: 9895 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664303.129515:0:9895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9895:1875550140506368:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664303.129603:0:9895:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403067480 going to sleep for 11 seconds 00000100:00100000:0.0:1788664303.139690:0:9895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9895:1875550140506368:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788664303.139721:0:9895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413dd8b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664303.140538:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664303.140581:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119447296 00000100:00100000:0.0:1788664303.140600:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119447296 00010000:00010000:0.0:1788664303.140635:0:10332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413dd76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d36b expref: 8 pid: 9895 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664303.140670:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:0.0:1788664303.140679:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304095880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2390:x1875550119447296:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664303.140693:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664303.140715:0:10332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413dd76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d36b expref: 8 pid: 9895 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.140729:0:10332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413dd76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d36b expref: 8 pid: 9895 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.140753:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413dd76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d36b expref: 8 pid: 9895 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.140767:0:10332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664303.140794:0:10332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664303.140800:0:10332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413dd8b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.140810:0:10332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413dd8b lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.140845:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664303.140901:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304095880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2390:x1875550119447296:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 222us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664303.140915:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00010000:00010000:0.0:1788664303.141497:0:9895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413dd8b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.141509:0:9895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413dd8b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.141530:0:9895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413dd8b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.141539:0:9895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413dd8b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.141547:0:9895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413dd8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.141554:0:9895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ba00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664303.141567:0:9895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413dd8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.141576:0:9895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413dd8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.141600:0:9895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413dd8b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.141620:0:9895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413dd8b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664303.141683:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2390:x1875550119447168:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 12444us (12572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664303.141692:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:3.0:1788664303.148690:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664303.149218:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119447552 00000100:00100000:1.0:1788664303.149228:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119447552 00000100:00100000:1.0:1788664303.149424:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:1.0:1788664303.149436:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:11278:x1875550119447552:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788664303.149531:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dd92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.149548:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413dbd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2f4 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.149558:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dd92 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.152830:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413dbd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2f4 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.152854:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413dbd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2f4 expref: 14 pid: 6512 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664303.152871:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f8a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875550140506496:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664303.152967:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664303.157506:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f8a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875550140506496:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664303.157535:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dd92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664303.163549:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664303.163635:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119447680 00000100:00100000:2.0:1788664303.163645:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119447680 00010000:00010000:2.0:1788664303.163693:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413dbd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2f4 expref: 15 pid: 6512 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664303.163726:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:2.0:1788664303.163735:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c412c73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:2390:x1875550119447680:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664303.163752:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664303.163758:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413dbd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2f4 expref: 15 pid: 6512 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.163795:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413dbd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2f4 expref: 15 pid: 6512 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.163818:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413dbd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d2f4 expref: 15 pid: 6512 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.163832:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:2.0:1788664303.163838:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dd92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.163848:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dd92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.163856:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dd92 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.163890:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664303.163943:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c412c73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:2390:x1875550119447680:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 209us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664303.163951:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00010000:00010000:1.0:1788664303.164183:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dd92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.164193:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dd92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.164527:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dd99 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.164547:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd53 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d356 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.164556:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dd99 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.164597:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d356 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.164611:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd53 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d356 expref: 14 pid: 6511 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664303.164626:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f8a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875550140506624:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664303.164701:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9240 going to sleep for 11 seconds 00000100:00100000:3.0:1788664303.171572:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664303.171614:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119447808 00000100:00100000:3.0:1788664303.171622:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119447808 00010000:00010000:3.0:1788664303.171664:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd53 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d356 expref: 15 pid: 6511 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664303.171700:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:3.0:1788664303.171710:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:2391:x1875550119447808:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664303.171725:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664303.171732:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd53 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d356 expref: 15 pid: 6511 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.171746:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd53 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d356 expref: 15 pid: 6511 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.171790:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93c3038d3b00) 00010000:00010000:3.0:1788664303.171804:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dd99 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.171816:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dd99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.171824:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dd99 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.171844:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664303.171899:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:2391:x1875550119447808:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 190us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664303.171907:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00010000:00010000:0.0:1788664303.172299:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dd53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d356 expref: 14 pid: 6511 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664303.172316:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f8a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875550140506624:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788664303.172339:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dd99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.172347:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dd99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.172353:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dd99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788664303.172456:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1788664303.172565:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:0.0:1788664303.172722:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1788664303.172838:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304096d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1875550140506752:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788664303.172915:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664303.172948:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42e9fe000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664303.173002:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140506752 00000100:00100000:3.0:1788664303.173008:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140506752 00000100:00100000:3.0:1788664303.173056:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788664303.173065:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1875550140506752:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788664303.174630:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1875550140506752:12345-0@lo:1000:mdt00_002.0 Request processed in 1559us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664303.174643:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788664303.175520:0:6513:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788664303.175527:0:6513:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c40532e300, transno 4294967304 00000100:00100000:2.0:1788664303.175539:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304096d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1875550140506752:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788664303.176014:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:2.0:1788664303.176082:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1875550140506880:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788664303.176132:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664303.177214:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42248dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664303.180895:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140506880 00000100:00100000:0.0:1788664303.180910:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140506880 00000100:00100000:0.0:1788664303.180976:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788664303.180986:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1875550140506880:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788664303.182005:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6513:x1875550140506880:12345-0@lo:1000:mdt00_002.0 Request processed in 1019us (5870us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788664303.182016:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788664303.185407:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1875550140506880:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788664303.185467:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dd99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185478:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dd99 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185486:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dd99 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185505:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664303.185509:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dd99 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185517:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dd99 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185535:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93c3038d3b00) 00010000:00010000:3.0:1788664303.185538:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664303.185543:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dd99 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185550:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413dd99 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185581:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dcc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185605:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dcc7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185610:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dcc7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185615:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664303.185617:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dcc7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185623:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dcc7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185641:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:3.0:1788664303.185643:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664303.185646:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dcc7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185652:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413dcc7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185744:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dda0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185758:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dce3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d33a expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185767:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dda0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185880:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dce3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d33a expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.185896:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dce3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d33a expref: 17 pid: 6512 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664303.185910:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875550140507008:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664303.186085:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403067480 going to sleep for 11 seconds 00000100:00100000:3.0:1788664303.191484:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664303.191561:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875550140507008:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788664303.191599:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dda0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664303.191652:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119447936 00000100:00100000:1.0:1788664303.191660:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119447936 00010000:00010000:1.0:1788664303.191695:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dce3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d33a expref: 18 pid: 6512 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664303.191755:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:1.0:1788664303.191764:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:2391:x1875550119447936:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664303.191800:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664303.191809:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dce3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d33a expref: 18 pid: 6512 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.191824:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dce3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d33a expref: 18 pid: 6512 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.191863:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dce3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d33a expref: 18 pid: 6512 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.191879:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:1.0:1788664303.191884:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dda0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.191895:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dda0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.191903:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dda0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.191929:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664303.191957:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dda0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.191977:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dda0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664303.191978:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:2391:x1875550119447936:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 214us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664303.191994:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00010000:00010000:3.0:1788664303.192000:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dda0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.192008:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dda0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.192015:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dda0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.192020:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ac00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664303.192025:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dda0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.192031:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dda0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.192043:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:3.0:1788664303.192046:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664303.192049:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dda0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.192056:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dda0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.192067:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dd92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.192073:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dd92 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.192099:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dd92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.192104:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84e00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664303.192107:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dd92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.192114:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dd92 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.192123:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c404785c00) 00010000:00010000:3.0:1788664303.192125:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788664303.192128:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dd92 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.192135:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413dd92 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664303.192341:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+16:11278:x1875550119447552:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 42908us (43657us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788664303.192350:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 93 00000020:00080000:3.0:1788664303.192354:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788664303.192822:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788664303.192827:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788664303.192857:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788664303.192865:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788664303.195347:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664303.195408:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119448192 00000100:00100000:0.0:1788664303.195416:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119448192 00000100:00100000:0.0:1788664303.195470:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1788664303.195480:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+16:11278:x1875550119448192:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788664303.195749:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788664303.195836:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967364 00010000:00010000:0.0:1788664303.195869:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dda7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.195885:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dda7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.195896:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dda7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.195905:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dda7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.195911:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dda7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.195931:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dda7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.195957:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788664303.196043:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:11278:x1875550119448192:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 563us (704us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788664303.196051:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000020:00080000:0.0:1788664303.196056:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788664303.196927:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664303.196939:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dda7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.196949:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956000 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664303.196954:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dda7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.196975:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dda7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.196991:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93c3038d3b00) 00010000:00010000:3.0:1788664303.196995:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788664303.197000:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dda7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.197007:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413dda7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.197019:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664303.197022:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664303.197023:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788664303.259932:0:14206:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788664303.259942:0:14206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788664303.259966:0:14206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788664303.259971:0:14206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788664303.441886:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664303.441922:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119448448 00000100:00100000:2.0:1788664303.441932:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119448448 00000100:00100000:2.0:1788664303.441988:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:2.0:1788664303.441997:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:11288:x1875550119448448:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664303.442019:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664303.442040:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413ddae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d372 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.442196:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413ddb5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.442211:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413ddb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.442223:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413ddb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664303.442239:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788664303.442334:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413ddae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d372 expref: 21 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.442353:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413ddb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d372 expref: 20 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.442361:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:2.0:1788664303.442364:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788664303.442367:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d600, rc 0) 00000100:00100000:2.0:1788664303.442421:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:11288:x1875550119448448:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 425us (544us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788664303.442428:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:0.0:1788664303.450869:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664303.450949:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119448576 00000100:00100000:2.0:1788664303.450958:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119448576 00000100:00100000:2.0:1788664303.451013:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:2.0:1788664303.451022:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:11288:x1875550119448576:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:2.0:1788664303.451100:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ddc3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451116:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ddc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451128:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ddc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451143:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ddca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451156:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ddca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451164:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ddca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451237:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451246:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451253:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664303.451297:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451309:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ddc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451315:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ddc3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451321:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ddc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451328:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0da00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664303.451332:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ddc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451340:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ddc3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451359:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:2.0:1788664303.451362:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664303.451367:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ddc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451374:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ddc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451385:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ddca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451391:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ddca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451396:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ddca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451402:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664303.451405:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ddca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451411:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ddca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451417:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c4130a6f00) 00010000:00010000:2.0:1788664303.451419:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664303.451422:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ddca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451428:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ddca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451450:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451456:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451462:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451467:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664303.451470:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451476:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451483:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4130a6200) 00010000:00010000:2.0:1788664303.451485:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664303.451488:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.451493:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664303.451565:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:11288:x1875550119448576:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 543us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664303.451573:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:2.0:1788664303.506376:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664303.506597:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119448832 00000100:00100000:3.0:1788664303.506607:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119448832 00000100:00100000:3.0:1788664303.506703:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:3.0:1788664303.506713:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:11291:x1875550119448832:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664303.506735:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664303.506756:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413ddd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d379 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.506872:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413dddf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.506886:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413dddf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.506896:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413dddf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.506925:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413dde6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.506932:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413dde6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.506939:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413dde6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507041:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dded lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507049:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dded lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507056:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dded lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664303.507065:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788664303.507148:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413dddf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507155:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413dddf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507161:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413dddf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507166:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502be00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664303.507170:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413dddf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507188:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413dddf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507200:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:3.0:1788664303.507203:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664303.507208:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413dddf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507214:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413dddf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507225:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413dde6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507231:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413dde6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507237:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413dde6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507242:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664303.507245:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413dde6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507250:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413dde6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507257:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c4350d0200) 00010000:00010000:3.0:1788664303.507259:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664303.507262:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413dde6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507288:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413dde6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507326:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413ddd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d379 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507339:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dded lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d379 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.507346:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:3.0:1788664303.507349:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664303.507351:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a800, rc 0) 00000100:00100000:3.0:1788664303.507413:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:11291:x1875550119448832:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 701us (1048us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1788664303.507598:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:0.0:1788664303.511827:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664303.511946:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119448960 00000100:00100000:2.0:1788664303.511956:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119448960 00000100:00100000:2.0:1788664303.512027:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:2.0:1788664303.512038:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:11291:x1875550119448960:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1788664303.512496:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.512516:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.512528:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.512566:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.512573:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddfb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.512949:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.512958:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664303.512964:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.512971:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.512984:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:2.0:1788664303.512987:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664303.512992:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddfb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.513012:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ddfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664303.513553:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:11291:x1875550119448960:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 1514us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664303.513564:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:0.0:1788664303.517678:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664303.517757:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119449216 00000100:00100000:3.0:1788664303.517767:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119449216 00000100:00100000:3.0:1788664303.517959:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788664303.517969:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c406b62450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:11291:x1875550119449216:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788664303.521480:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c406b62450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+23:11291:x1875550119449216:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 3502us (3810us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1788664303.521494:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788664303.569954:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664303.570215:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119449472 00000100:00100000:0.0:1788664303.570226:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119449472 00000100:00100000:0.0:1788664303.570464:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:0.0:1788664303.570476:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+23:10818:x1875550119449472:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788664303.570503:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664303.570536:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413de02 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d380 expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.570705:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.570721:0:9169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dded lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d379 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.570750:0:9169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.570832:0:9169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dded lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d379 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664303.570847:0:9169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dded lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d379 expref: 24 pid: 6513 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664303.570860:0:9169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304097480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9169:1875550140507136:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788664303.570948:0:9169:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42e9fe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664303.576445:0:9169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304097480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9169:1875550140507136:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664303.576476:0:9169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664303.577044:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664303.577132:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119449600 00000100:00100000:2.0:1788664303.577140:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119449600 00010000:00010000:2.0:1788664303.577175:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dded lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d379 expref: 25 pid: 6513 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664303.577205:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:2.0:1788664303.577213:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:2390:x1875550119449600:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664303.577226:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664303.577233:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dded lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d379 expref: 25 pid: 6513 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.577253:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dded lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d379 expref: 25 pid: 6513 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.577274:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dded lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d379 expref: 25 pid: 6513 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.577289:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:2.0:1788664303.577406:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.577433:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.577441:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.577469:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664303.577649:0:9169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.577667:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664303.577684:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788664303.577822:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413de02 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d380 expref: 26 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.577836:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d380 expref: 25 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.577844:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:1.0:1788664303.577847:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788664303.577849:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957400, rc 0) 00000100:00100000:2.0:1788664303.577909:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:2390:x1875550119449600:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 696us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664303.577917:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:1.0:1788664303.579925:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:10818:x1875550119449472:12345-192.168.203.52@tcp:101:bash.0 Request processed in 9441us (9970us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788664303.579939:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:0.0:1788664303.597349:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664303.600807:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119449728 00000100:00100000:3.0:1788664303.600823:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119449728 00000100:00100000:2.0:1788664303.601055:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:2.0:1788664303.601068:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:10818:x1875550119449728:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788664303.601095:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664303.601125:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413de17 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d387 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.601157:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413de1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.601172:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413de1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.601183:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413de1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.601311:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413de17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d387 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.601328:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413de1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d387 expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.601344:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:2.0:1788664303.601347:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788664303.601352:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c600, rc 0) 00000100:00100000:2.0:1788664303.601646:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:10818:x1875550119449728:12345-192.168.203.52@tcp:101:bash.0 Request processed in 578us (4305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664303.601654:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:0.0:1788664303.606956:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664303.607039:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119449984 00000100:00100000:2.0:1788664303.607049:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119449984 00000100:00100000:2.0:1788664303.607116:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:2.0:1788664303.607126:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:10818:x1875550119449984:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:2.0:1788664303.607351:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413de25 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.607368:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413de25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.607379:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413de25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664303.607420:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000004:00010000:2.0:1788664303.607439:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd876ef0 reply state 000000002a45f238 transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413de25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.607452:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413de25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.607460:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:2.0:1788664303.607463:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788664303.607480:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788664303.607520:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:2.0:1788664303.607628:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+29:10818:x1875550119449984:12345-192.168.203.52@tcp:36:bash.0 Request processed in 502us (679us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788664303.607635:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 100 00000020:00080000:2.0:1788664303.607640:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788664303.614322:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664303.614393:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119450112 00000100:00100000:1.0:1788664303.614404:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119450112 00000100:00100000:1.0:1788664303.614470:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:1.0:1788664303.614481:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+29:10818:x1875550119450112:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788664303.614507:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664303.614539:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413de2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d38e expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.614615:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413de2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d38e expref: 30 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.614650:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413de2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d38e expref: 30 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664303.614670:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:1.0:1788664303.614673:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788664303.614677:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85c00, rc 0) 00000100:00100000:1.0:1788664303.614740:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+30:10818:x1875550119450112:12345-192.168.203.52@tcp:101:bash.0 Request processed in 260us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664303.614747:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:0.0:1788664303.624244:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664303.624363:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119450240 00000100:00100000:3.0:1788664303.624372:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119450240 00000100:00100000:3.0:1788664303.624423:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:3.0:1788664303.624432:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43ced9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:10818:x1875550119450240:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788664303.624449:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664303.624468:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413de33 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d395 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788664303.624492:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9cd9ed, atime: 0x6a9cd9ec, ctime: 0x6a9cd9ed, blocks: 0x8 00010000:00010000:3.0:1788664303.624512:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:3.0:1788664303.624516:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664303.624523:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413de33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d395 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.624540:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413de33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d395 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.624552:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502aa00, rc 0) 00000100:00100000:3.0:1788664303.624621:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43ced9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:10818:x1875550119450240:12345-192.168.203.52@tcp:101:bash.0 Request processed in 191us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664303.624628:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:1.0:1788664303.631824:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664303.631939:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119450368 00000100:00100000:2.0:1788664303.631948:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119450368 00002000:00010000:2.0:1788664303.631984:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788664303.631988:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c43f8a9880 with x1875550119450368 ext(0->18446744073709551615) 00002000:00010000:2.0:1788664303.631999:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c43f8a9880. 00000100:00100000:2.0:1788664303.632031:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1788664303.632040:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119450368:12345-192.168.203.52@tcp:10:bash.0 00002000:00010000:2.0:1788664303.632319:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788664303.632323:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788664301 -> 1788664303 00002000:00010000:2.0:1788664303.632325:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788664300 -> 1788664300 00002000:00010000:2.0:1788664303.632328:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788664301 -> 1788664303 00002000:00010000:2.0:1788664303.632330:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788664303.632395:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2391:x1875550119450368:12345-192.168.203.52@tcp:10:bash.0 Request processed in 356us (583us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788664303.632403:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00002000:00010000:2.0:1788664303.632407:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788664303.632409:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c43f8a9880 with x1875550119450368 ext(0->18446744073709551615) 00002000:00010000:2.0:1788664303.632414:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c43f8a9880. 00000100:00100000:1.0:1788664303.725385:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664303.725534:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119450496 00000100:00100000:2.0:1788664303.725544:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119450496 00000100:00100000:2.0:1788664303.725611:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:2.0:1788664303.725622:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+30:11305:x1875550119450496:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:2.0:1788664303.725717:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de3a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.725735:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.725747:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.725762:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413de41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.725796:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413de41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.725805:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413de41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726309:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726320:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726327:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664303.726375:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726385:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726401:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de3a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726409:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726415:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0da00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664303.726420:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726427:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de3a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726438:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:2.0:1788664303.726441:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664303.726445:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726451:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726464:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413de41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726471:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413de41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726477:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413de41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726481:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ca00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664303.726488:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413de41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726495:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413de41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726501:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c4130a6200) 00010000:00010000:2.0:1788664303.726503:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664303.726506:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413de41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726511:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413de41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726524:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726529:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de48 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726535:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726539:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ce00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664303.726542:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726548:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726554:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:2.0:1788664303.726556:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664303.726562:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de48 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.726568:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664303.726657:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+30:11305:x1875550119450496:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1035us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664303.726665:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:1.0:1788664303.773764:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664303.774732:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119450752 00000100:00100000:3.0:1788664303.774744:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119450752 00000100:00100000:3.0:1788664303.774833:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:3.0:1788664303.774844:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+30:11308:x1875550119450752:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664303.774864:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664303.774893:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413de4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d39c expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.774966:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413de56 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.774981:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413de56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.774992:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413de56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775006:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775012:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775019:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775133:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413de64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775145:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413de64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775152:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413de64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664303.775162:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788664303.775233:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413de56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775250:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413de56 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775257:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413de56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775264:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664303.775268:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413de56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775275:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413de56 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775287:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:3.0:1788664303.775289:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664303.775294:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413de56 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775299:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413de56 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775312:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775318:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de5d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775323:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775327:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502be00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664303.775336:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775342:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de5d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775350:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c4350d0a00) 00010000:00010000:3.0:1788664303.775353:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664303.775355:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de5d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775360:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775400:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413de4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d39c expref: 33 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775414:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413de64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d39c expref: 32 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.775421:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:3.0:1788664303.775423:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788664303.775426:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502bc00, rc 0) 00000100:00100000:3.0:1788664303.775502:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+32:11308:x1875550119450752:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 659us (1746us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788664303.775511:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:3.0:1788664303.781387:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664303.782172:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119450880 00000100:00100000:2.0:1788664303.782183:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119450880 00000100:00100000:2.0:1788664303.782246:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:2.0:1788664303.782256:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+32:11308:x1875550119450880:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1788664303.782323:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.782342:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d380 expref: 32 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.782352:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de72 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.782388:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d380 expref: 32 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.782402:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d380 expref: 32 pid: 9169 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664303.782417:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875550140507264:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664303.782589:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42248d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664303.800934:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664303.801048:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875550140507264:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788664303.801074:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664303.801220:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119451136 00000100:00100000:1.0:1788664303.801227:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119451136 00000100:00100000:1.0:1788664303.801284:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:1.0:1788664303.801294:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+33:6160:x1875550119451136:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788664303.801597:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+34:6160:x1875550119451136:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 304us (675us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788664303.801605:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1788664303.806231:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664303.806551:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119451264 00000100:00100000:3.0:1788664303.806561:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119451264 00010000:00010000:3.0:1788664303.806613:0:10332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d380 expref: 34 pid: 9169 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664303.806660:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:3.0:1788664303.806670:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+34:2390:x1875550119451264:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664303.806688:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664303.806695:0:10332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d380 expref: 34 pid: 9169 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.806709:0:10332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d380 expref: 34 pid: 9169 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.806735:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413de09 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d380 expref: 34 pid: 9169 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.806753:0:10332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:3.0:1788664303.806759:0:10332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.806810:0:10332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.806819:0:10332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de72 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.806850:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664303.806905:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+33:2390:x1875550119451264:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 236us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664303.806912:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00010000:00010000:2.0:1788664303.807359:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.807369:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.807411:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.807418:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.807425:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.807431:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ce00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664303.807435:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.807443:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.807452:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:2.0:1788664303.807455:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664303.807459:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.807479:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664303.807532:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+32:11308:x1875550119450880:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 25276us (26152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664303.807539:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:0.0:1788664303.809573:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664303.809662:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119451520 00000100:00100000:1.0:1788664303.809672:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119451520 00000100:00100000:1.0:1788664303.809725:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1788664303.809743:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+32:11308:x1875550119451520:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788664303.809977:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+33:11308:x1875550119451520:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 244us (412us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788664303.810000:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:3.0:1788664303.908163:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664303.908320:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119451776 00000100:00100000:2.0:1788664303.908331:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119451776 00000100:00100000:2.0:1788664303.908646:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:2.0:1788664303.908657:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+33:11319:x1875550119451776:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:2.0:1788664303.908681:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664303.908701:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d3a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909127:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de80 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909143:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909158:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909171:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413de87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909178:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413de87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909199:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413de87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909309:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413de8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909319:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413de8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909327:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413de8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664303.909337:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788664303.909418:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909425:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de80 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909433:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909440:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0da00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664303.909444:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909452:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de80 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909464:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:2.0:1788664303.909467:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664303.909479:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909487:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413de80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909501:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413de87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909508:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413de87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909514:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413de87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909520:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0d200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664303.909522:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413de87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909529:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413de87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909538:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c4130a6200) 00010000:00010000:2.0:1788664303.909540:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664303.909543:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413de87 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909549:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413de87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909604:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413de79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3a3 expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909632:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413de8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3a3 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.909640:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:2.0:1788664303.909643:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664303.909646:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0ca00, rc 0) 00000100:00100000:2.0:1788664303.910484:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+35:11319:x1875550119451776:12345-192.168.203.52@tcp:101:cat.0 Request processed in 1824us (2323us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788664303.910494:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:0.0:1788664303.921268:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664303.923075:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119452032 00000100:00100000:1.0:1788664303.923095:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119452032 00000100:00100000:1.0:1788664303.923626:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:1.0:1788664303.923642:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+35:11319:x1875550119452032:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:1.0:1788664303.925000:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+36:11319:x1875550119452032:12345-192.168.203.52@tcp:35:cat.0 Request processed in 1352us (3736us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788664303.925014:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1788664303.961597:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664303.961720:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119452288 00000100:00100000:3.0:1788664303.961732:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119452288 00000100:00100000:3.0:1788664303.961849:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:3.0:1788664303.961861:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+36:11320:x1875550119452288:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:3.0:1788664303.961940:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788664303.961973:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413de2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d38e expref: 36 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.962001:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413de8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3a3 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.962017:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413de64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d39c expref: 34 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.962030:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413de1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d387 expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.962042:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:3.0:1788664303.962047:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664303.962079:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de9c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.962096:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de9c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.962109:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de9c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.962124:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dea3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.962160:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dea3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.962167:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dea3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.962677:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413deaa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.962689:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413deaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.962697:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413deaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788664303.963066:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00010000:00010000:3.0:1788664303.963130:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413deb1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963153:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413deb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963164:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413deb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963182:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413deb1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963189:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413deb1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963196:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413deb1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963241:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664303.963269:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413deaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963290:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413deaa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963297:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413deaa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963304:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664303.963309:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413deaa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963319:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413deaa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963331:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:3.0:1788664303.963335:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788664303.963340:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413deaa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963347:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413deaa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963376:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de9c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963618:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de9c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963627:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de9c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963639:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502be00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664303.963643:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de9c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963650:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de9c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963659:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:3.0:1788664303.963662:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664303.963665:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de9c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963672:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413de9c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664303.963685:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000861e65c2 reply state 00000000fd26e0f1 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dea3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963697:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dea3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664303.963703:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c4350d0a00) 00010000:00010000:3.0:1788664303.963706:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788664303.963710:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788664303.963872:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+34:11320:x1875550119452288:12345-192.168.203.52@tcp:36:rm.0 Request processed in 2008us (2294us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788664303.963882:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 106 00010000:00010000:2.0:1788664303.963991:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664303.964001:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413deb1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.964008:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a600 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:2.0:1788664303.964012:0:7453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413deb1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.964019:0:7453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413deb1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.964028:0:7453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:2.0:1788664303.964031:0:7453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788664303.964034:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413deb1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.964041:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413deb1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664303.964053:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664303.964063:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664303.964065:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664304.044755:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664304.045018:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119452544 00000100:00100000:3.0:1788664304.045029:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119452544 00000100:00100000:3.0:1788664304.045097:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:3.0:1788664304.045120:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+34:11326:x1875550119452544:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788664304.045145:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664304.045164:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413deb8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d3aa expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.045277:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413debf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.045504:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413debf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.045517:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413debf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.045529:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413dec6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.045536:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413dec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.045542:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413dec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788664304.046047:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788664304.046204:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413decd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.046215:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413decd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.046223:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413decd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.046260:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413debf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.046267:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413debf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.046273:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413debf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.046279:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664304.046283:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413debf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.046548:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413debf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.046563:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:3.0:1788664304.046566:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664304.046571:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413debf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.046587:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413debf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664304.046602:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be36123b reply state 00000000684ea66e transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413dec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.046612:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413dec6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.046619:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c4350d0a00) 00010000:00010000:3.0:1788664304.046627:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788664304.046630:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788664304.046660:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413deb8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3aa expref: 37 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.046675:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413decd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3aa expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.046682:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0500) 00010000:00010000:3.0:1788664304.046684:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664304.046686:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502b200, rc 0) 00000100:00100000:3.0:1788664304.046858:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+37:11326:x1875550119452544:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1739us (2113us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788664304.046866:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:0.0:1788664304.055288:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664304.055588:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119452672 00000100:00100000:3.0:1788664304.055598:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119452672 00000100:00100000:3.0:1788664304.055671:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:3.0:1788664304.055680:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2392:x1875550119452672:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788664304.055700:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664304.055721:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091bebf73/0xcd11f61c1413dedb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d3b1 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788664304.055747:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788664304.055767:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=399s v=(0 0) 00010000:00010000:3.0:1788664304.055812:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664304.055822:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091bebf73/0xcd11f61c1413dedb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b1 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.056013:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091bebf73/0xcd11f61c1413dedb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b1 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.056026:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502be00, rc 0) 00000100:00080000:2.0:1788664304.057112:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664304.057426:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2392:x1875550119452672:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1741us (2141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664304.057438:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00010000:00010000:2.0:1788664304.062161:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664304.074722:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664304.074805:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119452800 00000100:00100000:3.0:1788664304.074815:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119452800 00000100:00100000:3.0:1788664304.074881:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:3.0:1788664304.074891:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:11326:x1875550119452800:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788664304.074908:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664304.074926:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d3b8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.074957:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091bebf73/0xcd11f61c1413dedb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b1 expref: 9 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.074966:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664304.074970:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664304.074976:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.075234:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091bebf73/0xcd11f61c1413dedb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b1 expref: 9 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.075262:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091bebf73/0xcd11f61c1413dedb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b1 expref: 9 pid: 8426 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664304.075277:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1875550140507392:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664304.075546:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c407800240 going to sleep for 11 seconds 00000100:00100000:3.0:1788664304.082414:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1875550140507392:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664304.082451:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.082471:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502b600, rc 0) 00000100:00100000:3.0:1788664304.082533:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:11326:x1875550119452800:12345-192.168.203.52@tcp:101:bash.0 Request processed in 7643us (7819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664304.082542:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1788664304.082712:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664304.083170:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119452928 00000100:00100000:2.0:1788664304.083178:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119452928 00010000:00010000:2.0:1788664304.083211:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091bebf73/0xcd11f61c1413dedb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b1 expref: 9 pid: 8426 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664304.083247:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:2.0:1788664304.083257:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2391:x1875550119452928:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664304.083271:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664304.083293:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091bebf73/0xcd11f61c1413dedb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b1 expref: 9 pid: 8426 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.083306:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091bebf73/0xcd11f61c1413dedb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b1 expref: 9 pid: 8426 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.083329:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091bebf73/0xcd11f61c1413dedb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b1 expref: 9 pid: 8426 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.083343:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664304.083347:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664304.083355:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.083383:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.083421:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664304.083436:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1875550140507520:192.168.203.52@tcp:105: 00000100:00100000:2.0:1788664304.083518:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42248df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664304.087687:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1875550140507520:192.168.203.52@tcp:105: 00010000:00010000:2.0:1788664304.087713:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664304.087797:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2391:x1875550119452928:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 4512us (5057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664304.087808:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:0.0:1788664304.088641:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664304.088711:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119453184 00000100:00100000:3.0:1788664304.088720:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119453184 00000100:00100000:3.0:1788664304.088798:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1788664304.088808:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+37:11326:x1875550119453184:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:3.0:1788664304.089114:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+38:11326:x1875550119453184:12345-192.168.203.52@tcp:35:bash.0 Request processed in 307us (475us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788664304.089121:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:0.0:1788664304.311183:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664304.311340:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119453312 00000100:00100000:2.0:1788664304.311351:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119453312 00000100:00100000:2.0:1788664304.311426:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:2.0:1788664304.311436:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+38:11342:x1875550119453312:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664304.311469:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664304.311489:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413dee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d3bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.312502:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413def0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.312520:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413def0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.312544:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413def0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664304.312610:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788664304.312614:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664304.312635:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413def0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.312666:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413dee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3bf expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.312687:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413def0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3bf expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.312697:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:2.0:1788664304.312700:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664304.312704:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d200, rc 0) 00000100:00100000:2.0:1788664304.312812:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+39:11342:x1875550119453312:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1377us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664304.312821:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:2.0:1788664304.321790:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664304.322344:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119453568 00000100:00100000:3.0:1788664304.322363:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119453568 00000100:00100000:3.0:1788664304.322604:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:3.0:1788664304.322618:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+39:11342:x1875550119453568:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664304.322666:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664304.322695:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413def7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d3c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.322888:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413defe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.322908:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413defe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.322923:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413defe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664304.322937:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788664304.323080:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413def7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3c6 expref: 42 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.323102:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413defe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3c6 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.323112:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0500) 00010000:00010000:3.0:1788664304.323116:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664304.323120:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a000, rc 0) 00000100:00100000:3.0:1788664304.323233:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+41:11342:x1875550119453568:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 617us (1465us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1788664304.323243:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:0.0:1788664304.329978:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664304.330021:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119453696 00000100:00100000:3.0:1788664304.330034:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119453696 00000100:00100000:3.0:1788664304.330125:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788664304.330156:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664304.330171:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304096d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+41:2391:x1875550119453696:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664304.330195:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664304.330230:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413defe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3c6 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.330256:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0500) 00010000:00010000:3.0:1788664304.330262:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664304.330263:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119453952 00000100:00100000:2.0:1788664304.330267:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119453952 00000100:00100000:3.0:1788664304.330339:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304096d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+41:2391:x1875550119453696:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 171us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664304.330348:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788664304.330684:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:2.0:1788664304.330694:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+40:11342:x1875550119453952:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664304.330720:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664304.330741:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413df0c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d3cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.331635:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413df13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.331657:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413df13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.331671:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413df13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664304.331686:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788664304.333568:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413df0c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3cd expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.333616:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413df13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3cd expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.333627:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0500) 00010000:00010000:0.0:1788664304.333630:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788664304.333634:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957e00, rc 0) 00000100:00100000:0.0:1788664304.333844:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+42:11342:x1875550119453952:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 3149us (3684us total) trans 4294967382 rc 0/0 00000100:00100000:0.0:1788664304.333854:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:0.0:1788664304.342817:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664304.342987:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119454080 00000100:00100000:2.0:1788664304.342999:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119454080 00000100:00100000:2.0:1788664304.343068:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:2.0:1788664304.343079:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2392:x1875550119454080:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:2.0:1788664304.343157:0:9895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413df21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.343184:0:9895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.343193:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664304.343198:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788664304.343204:0:9895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413df21 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.343261:0:9895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.343279:0:9895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 8 pid: 8428 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664304.343299:0:9895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9895:1875550140507648:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664304.343573:0:9895:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42248df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664304.347275:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664304.347718:0:9895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9895:1875550140507648:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788664304.348625:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119454208 00000100:00100000:0.0:1788664304.348638:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119454208 00010000:00010000:2.0:1788664304.348657:0:9895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413df21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1788664304.348712:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff93c43f8abb80 x1875550119454208/t0(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:610/0 lens 504/0 e 0 to 0 dl 1788664315 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788664304.348723:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c43f8abb80 with x1875550119454208 ext(0->8) 00010000:00010000:0.0:1788664304.348731:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 9 pid: 8428 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.348761:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 9 pid: 8428 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788664304.349102:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c43f8abb80 00000100:00100000:2.0:1788664304.349304:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1788664304.349319:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2391:x1875550119454208:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:2.0:1788664304.352311:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:2391:x1875550119454208:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 2981us (5035us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788664304.352330:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00002000:00100000:2.0:1788664304.352348:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff93c43f8abb80 x1875550119454208/t4294967303(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:610/0 lens 504/448 e 0 to 0 dl 1788664315 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664304.352359:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c43f8abb80 with x1875550119454208 ext(0->8) 00010000:00010000:2.0:1788664304.352372:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 11 pid: 8428 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.352468:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 11 pid: 8428 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664304.352477:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c43f8abb80 00000100:00100000:0.0:1788664304.355525:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664304.356072:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119454336 00000100:00100000:1.0:1788664304.356086:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119454336 00010000:00010000:1.0:1788664304.356143:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 11 pid: 8428 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664304.356197:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:1.0:1788664304.356209:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c412c70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:2393:x1875550119454336:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664304.356232:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788664304.356257:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788664304.356261:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788664304 00002000:00010000:1.0:1788664304.356263:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788664304 00002000:00010000:1.0:1788664304.356266:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788664304 00002000:00010000:1.0:1788664304.356268:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788664304.356284:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 11 pid: 8428 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664304.356325:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 11 pid: 8428 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664304.356354:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d870c76/0xcd11f61c1413dee2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3b8 expref: 11 pid: 8428 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664304.356376:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664304.356449:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664304.356458:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413df21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664304.356469:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413df21 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664304.356512:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664304.356603:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c412c70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:2393:x1875550119454336:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 395us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664304.356612:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00010000:00010000:2.0:1788664304.357294:0:9895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413df21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.357310:0:9895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413df21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.357340:0:9895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413df21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.357363:0:9895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413df21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.357372:0:9895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413df21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.357498:0:9895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c600 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:2.0:1788664304.357506:0:9895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413df21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.357518:0:9895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413df21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.357536:0:9895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413df21 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.357544:0:9895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413df21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664304.357654:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2392:x1875550119454080:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 14573us (14886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664304.357665:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:0.0:1788664304.361513:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664304.361691:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119454592 00000100:00100000:3.0:1788664304.361704:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119454592 00000100:00100000:3.0:1788664304.361813:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:3.0:1788664304.361826:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c406b60850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+42:11342:x1875550119454592:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:3.0:1788664304.361917:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413df13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3cd expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788664304.362204:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788664304.362233:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:3.0:1788664304.363102:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:3.0:1788664304.363162:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.363183:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413decd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3aa expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.363192:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df28 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.363258:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413decd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3aa expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.363350:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413decd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3aa expref: 46 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664304.363367:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a90700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6514:1875550140507776:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664304.363622:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c407800180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664304.367336:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664304.367612:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a90700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6514:1875550140507776:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664304.367649:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664304.367707:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119454720 00000100:00100000:2.0:1788664304.367716:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119454720 00010000:00010000:2.0:1788664304.367765:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413decd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3aa expref: 47 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664304.368031:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:2.0:1788664304.368043:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+47:2390:x1875550119454720:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664304.368063:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664304.368071:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413decd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3aa expref: 47 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.368083:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413decd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3aa expref: 47 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.368112:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413decd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3aa expref: 47 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.368130:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0500) 00010000:00010000:2.0:1788664304.368148:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.368161:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.368169:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df28 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.368201:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664304.368368:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+46:2390:x1875550119454720:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 326us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664304.368379:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00010000:00010000:0.0:1788664304.368546:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.368555:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788664304.368721:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:0.0:1788664304.368884:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1788664304.368993:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304096d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875550140507904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788664304.369072:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664304.369123:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412c5f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788664304.369327:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140507904 00000100:00100000:1.0:1788664304.369335:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140507904 00000100:00080000:0.0:1788664304.369504:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664304.369563:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788664304.369584:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6514:x1875550140507904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788664304.369695:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6514:x1875550140507904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664304.369702:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788664304.369763:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304096d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875550140507904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788664304.369952:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:1.0:1788664304.370009:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f8a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875550140508032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788664304.370049:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664304.370077:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140508032 00000100:00100000:1.0:1788664304.370081:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140508032 00000100:00100000:1.0:1788664304.370113:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788664304.370121:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6514:x1875550140508032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788664304.370253:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6514:x1875550140508032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 132us (203us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788664304.370260:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788664304.370550:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788664304.370584:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f8a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875550140508032:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788664304.370636:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1788664304.370673:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664304.370683:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df28 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664304.370691:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664304.370698:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664304.370704:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664304.370712:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df28 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664304.370742:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0500) 00010000:00010000:1.0:1788664304.370745:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788664304.370751:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df28 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664304.370758:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df28 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788664304.370927:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788664304.371002:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788664304.371017:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399508244858ns, next at 400508241443ns, rc = 0 00000001:00080000:1.0:1788664304.371024:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:1.0:1788664304.371049:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0500) 00010000:00010000:1.0:1788664304.371052:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788664304.371060:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413df13 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3cd expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664304.372049:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c406b60850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+49:11342:x1875550119454592:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 10219us (10548us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788664304.372064:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000020:00080000:1.0:1788664304.372072:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788664304.379594:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664304.379888:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119454848 00000100:00100000:2.0:1788664304.379923:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119454848 00000100:00100000:3.0:1788664304.380154:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00100000:3.0:1788664304.380168:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+49:11342:x1875550119454848:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664304.380204:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664304.380235:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413df2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d3d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.380335:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413df2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3d4 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.380352:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413df2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3d4 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.380373:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:3.0:1788664304.381110:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664304.381116:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502ae00, rc 0) 00000100:00100000:3.0:1788664304.381215:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+50:11342:x1875550119454848:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1047us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664304.381223:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00100000:0.0:1788664304.391336:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664304.391449:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119455104 00000100:00100000:1.0:1788664304.391463:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119455104 00000100:00100000:1.0:1788664304.391536:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:1.0:1788664304.391550:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+50:11342:x1875550119455104:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788664304.391949:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+51:11342:x1875550119455104:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 401us (626us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788664304.391980:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:1.0:1788664304.500620:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664304.500893:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119455232 00000100:00100000:3.0:1788664304.500907:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119455232 00000100:00100000:3.0:1788664304.501060:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:3.0:1788664304.501073:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+51:11352:x1875550119455232:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:3.0:1788664304.501541:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413df36 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.501563:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413df36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.501586:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413df36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.501600:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.501608:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.501615:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.501714:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413df44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.501724:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413df44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.501752:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413df44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664304.504479:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413df44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504516:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413df36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504526:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413df36 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504534:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413df36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504540:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664304.504546:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413df36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504555:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413df36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504585:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:2.0:1788664304.504589:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664304.504596:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413df36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504603:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413df36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504625:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504632:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504663:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504669:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664304.504672:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504678:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504687:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c4350d0a00) 00010000:00010000:2.0:1788664304.504690:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664304.504693:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504699:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413df3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504711:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413df44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504718:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413df44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504724:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413df44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504730:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664304.504732:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413df44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504754:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413df44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504764:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:2.0:1788664304.504766:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664304.504823:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413df44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.504832:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413df44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664304.504967:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+51:11352:x1875550119455232:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 3891us (4354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664304.504978:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:2.0:1788664304.538023:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664304.538321:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119455488 00000100:00100000:0.0:1788664304.538336:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119455488 00000100:00100000:0.0:1788664304.538415:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:0.0:1788664304.538427:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+51:11355:x1875550119455488:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664304.538455:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664304.538482:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d3db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.538607:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413df52 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.538625:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413df52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.538636:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413df52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.538648:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413df59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.538656:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413df59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.538663:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413df59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.538862:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413df60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.538870:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413df60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.538877:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413df60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664304.538888:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788664304.538986:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413df52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.538994:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413df52 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.539009:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413df52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.539016:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957a00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664304.539020:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413df52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.539029:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413df52 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.539042:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:0.0:1788664304.539045:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664304.539050:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413df52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.539057:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413df52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.539071:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413df59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.539077:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413df59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.539082:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413df59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.539086:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664304.539089:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413df59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.539107:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413df59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.539115:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c4350d0a00) 00010000:00010000:0.0:1788664304.539118:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664304.539121:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413df59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.539126:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413df59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.539166:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3db expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.539180:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413df60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3db expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.539187:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:0.0:1788664304.539189:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664304.539192:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956800, rc 0) 00000100:00100000:0.0:1788664304.539280:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+53:11355:x1875550119455488:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 855us (1272us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788664304.539289:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:1.0:1788664304.548748:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664304.548927:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119455616 00000100:00100000:3.0:1788664304.548939:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119455616 00000100:00100000:3.0:1788664304.549018:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:3.0:1788664304.549029:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+53:11355:x1875550119455616:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:3.0:1788664304.549117:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413df6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.549140:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413df6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.549154:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413df6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.549199:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413df6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.549206:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413df6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.549213:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413df6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.549220:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502be00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664304.549225:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413df6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.549233:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413df6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.549263:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:3.0:1788664304.549266:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664304.549272:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413df6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.549279:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413df6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664304.549374:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+53:11355:x1875550119455616:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 344us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664304.549382:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:1.0:1788664304.555610:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664304.555840:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119455872 00000100:00100000:0.0:1788664304.555854:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119455872 00000100:00100000:0.0:1788664304.555926:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:0.0:1788664304.555939:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+53:11355:x1875550119455872:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788664304.556256:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+54:11355:x1875550119455872:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 318us (661us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788664304.556265:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:2.0:1788664304.656656:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664304.656839:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119456128 00000100:00100000:0.0:1788664304.656853:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119456128 00000100:00100000:0.0:1788664304.656945:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:0.0:1788664304.656957:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+54:11365:x1875550119456128:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788664304.656992:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664304.656996:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788664304.657033:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413def0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3bf expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.657058:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:0.0:1788664304.657065:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664304.657083:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df75 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d3e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.657492:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413df7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.657511:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413df7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.657524:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413df7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664304.657537:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788664304.657927:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df75 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3e2 expref: 56 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.657964:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413df7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3e2 expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.657973:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:0.0:1788664304.657976:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664304.657979:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957800, rc 0) 00000100:00100000:0.0:1788664304.658077:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+55:11365:x1875550119456128:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1121us (1443us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788664304.658085:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:2.0:1788664304.662502:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664304.662563:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664304.662723:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119456384 00000100:00100000:1.0:1788664304.662747:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119456384 00000100:00100000:1.0:1788664304.662874:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1788664304.662887:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+55:2392:x1875550119456384:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664304.662908:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664304.662940:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413df7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3e2 expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664304.662965:0:10332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:1.0:1788664304.662972:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664304.663040:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+54:2392:x1875550119456384:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 156us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664304.663048:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788664304.663651:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119456256 00000100:00100000:3.0:1788664304.663660:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119456256 00000100:00100000:3.0:1788664304.663715:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:3.0:1788664304.663725:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+54:11365:x1875550119456256:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788664304.663753:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664304.663800:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413df8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d3e9 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.664070:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413df91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.664089:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413df91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.664102:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413df91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.664263:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413df8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3e9 expref: 56 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.665004:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413df91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3e9 expref: 55 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.665018:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:3.0:1788664304.665021:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788664304.665026:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a600, rc 0) 00000100:00100000:3.0:1788664304.665121:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+55:11365:x1875550119456256:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1397us (2634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664304.665140:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:2.0:1788664304.672395:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664304.672520:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119456640 00000100:00100000:0.0:1788664304.672533:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119456640 00000100:00100000:0.0:1788664304.672619:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:0.0:1788664304.672631:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+55:11365:x1875550119456640:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:0.0:1788664304.672706:0:9169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664304.672743:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413df60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3db expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.672768:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:0.0:1788664304.672826:0:9169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664304.673059:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.673076:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.673088:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788664304.673173:0:9169:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:0.0:1788664304.673199:0:9169:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3cacf91 reply state 00000000b5b5cafb transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.673213:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.673221:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:0.0:1788664304.673224:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788664304.673227:0:9169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788664304.673346:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+57:11365:x1875550119456640:12345-192.168.203.52@tcp:36:bash.0 Request processed in 716us (966us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788664304.673354:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 117 00000020:00080000:0.0:1788664304.673360:0:9169:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788664304.676673:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664304.677206:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119456768 00000100:00100000:0.0:1788664304.677221:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119456768 00000100:00100000:0.0:1788664304.677307:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:0.0:1788664304.677320:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+57:11365:x1875550119456768:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788664304.677355:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664304.677864:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413df9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d3f0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.678038:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dfa6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.678060:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.678073:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664304.678122:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788664304.678128:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788664304.678154:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.678192:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413df9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3f0 expref: 59 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.678212:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dfa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3f0 expref: 58 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.678222:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:0.0:1788664304.678226:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664304.678231:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956800, rc 0) 00000100:00100000:0.0:1788664304.678337:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+58:11365:x1875550119456768:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1019us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664304.678346:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:2.0:1788664304.683606:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664304.683801:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119457024 00000100:00100000:0.0:1788664304.683814:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119457024 00000100:00100000:0.0:1788664304.683881:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:0.0:1788664304.683894:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+58:11365:x1875550119457024:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:0.0:1788664304.684234:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:11365:x1875550119457024:12345-192.168.203.52@tcp:35:bash.0 Request processed in 341us (642us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788664304.684243:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:2.0:1788664304.768632:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664304.769936:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119457152 00000100:00100000:0.0:1788664304.769954:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119457152 00000100:00100000:0.0:1788664304.770068:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:0.0:1788664304.770079:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:11371:x1875550119457152:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664304.770113:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664304.770139:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413dfad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d3f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.771425:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dfb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.771445:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.771461:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664304.771528:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788664304.771532:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788664304.771814:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.771848:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413dfad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3f7 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.771872:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3f7 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.771883:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:0.0:1788664304.771887:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664304.771891:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956400, rc 0) 00000100:00100000:1.0:1788664304.772361:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+60:11371:x1875550119457152:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2280us (3739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664304.772370:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:1.0:1788664304.777508:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664304.777764:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119457280 00000100:00100000:3.0:1788664304.777801:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119457280 00000100:00100000:3.0:1788664304.777894:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:3.0:1788664304.777907:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+60:11371:x1875550119457280:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664304.777936:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664304.777964:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413dfbb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d3fe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778049:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dfc2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778069:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dfc2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778082:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dfc2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778093:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dfc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778120:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778127:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778220:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dfd0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778231:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778238:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664304.778290:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788664304.778296:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788664304.778317:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778346:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778355:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dfc2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778362:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dfc2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778369:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dfc2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778386:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664304.778391:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dfc2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778401:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dfc2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778415:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:3.0:1788664304.778419:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664304.778424:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dfc2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778431:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413dfc2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778445:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778451:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dfc9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778456:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dfc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778461:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664304.778464:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dfc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778469:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dfc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778490:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c4350d0a00) 00010000:00010000:3.0:1788664304.778493:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664304.778497:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dfc9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778503:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413dfc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778546:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413dfbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3fe expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778562:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dfd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3fe expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.778569:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:3.0:1788664304.778582:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664304.778585:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502ba00, rc 0) 00000100:00100000:3.0:1788664304.778672:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:11371:x1875550119457280:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 768us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664304.778681:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:0.0:1788664304.784301:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664304.784655:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664304.784753:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119457664 00000100:00100000:2.0:1788664304.784767:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119457664 00000100:00100000:2.0:1788664304.784932:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:2.0:1788664304.784945:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:11371:x1875550119457664:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664304.784975:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664304.785003:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dfd7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d405 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.785175:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.785196:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dfa6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3f0 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.785205:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dfd0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3fe expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.785215:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.785260:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dfd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3fe expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.785277:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dfd0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3fe expref: 62 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664304.785294:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140508160:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788664304.785434:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dfa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3f0 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.785445:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dfa6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3f0 expref: 62 pid: 6511 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664304.785455:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140508288:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664304.785492:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42248df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788664304.792882:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119457408 00000100:00100000:3.0:1788664304.792904:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119457408 00010000:00010000:3.0:1788664304.792969:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dfd0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3fe expref: 63 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664304.793017:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:3.0:1788664304.793027:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303740700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+63:2390:x1875550119457408:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664304.793068:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664304.793076:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dfd0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3fe expref: 63 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.793090:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dfd0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3fe expref: 63 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.793116:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:3.0:1788664304.793122:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.793132:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.793138:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664304.793214:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303740700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+63:2390:x1875550119457408:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 188us (8927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664304.793222:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:0.0:1788664304.793680:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664304.793846:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119457792 00000100:00100000:2.0:1788664304.793852:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119457792 00010000:00010000:2.0:1788664304.793877:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dfa6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3f0 expref: 63 pid: 6511 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664304.793916:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:2.0:1788664304.793925:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+63:2391:x1875550119457792:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664304.793936:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664304.793941:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dfa6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3f0 expref: 63 pid: 6511 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.793953:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dfa6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3f0 expref: 63 pid: 6511 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.793970:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:2.0:1788664304.793974:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.793984:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.793992:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.794014:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664304.794053:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+63:2391:x1875550119457792:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 129us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664304.794062:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00010000:00010000:3.0:1788664304.794254:0:6511:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.52@tcp) returned -22 from blocking AST (req@00000000d64cfdf6 x1875550140508160) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dfd0 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3fe expref: 62 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.794267:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dfd0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3fe expref: 62 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664304.794913:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140508160:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664304.794979:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413dfa6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3f0 expref: 61 pid: 6511 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664304.795011:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140508288:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664304.795039:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:3.0:1788664304.795048:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.795059:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.795064:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664304.795089:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788664304.795260:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413dfd7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d405 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.795290:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d405 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664304.795299:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:3.0:1788664304.795301:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788664304.795304:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0ce00, rc 0) 00000100:00100000:3.0:1788664304.798012:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:11371:x1875550119457664:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 13054us (13341us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788664304.798028:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:2.0:1788664304.801280:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664304.801481:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119458048 00000100:00100000:0.0:1788664304.801494:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119458048 00000100:00100000:0.0:1788664304.801596:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788664304.801609:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:11371:x1875550119458048:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:0.0:1788664304.801629:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664304.801662:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413df2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3d4 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664304.804935:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:0.0:1788664304.804947:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664304.805068:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+60:11371:x1875550119458048:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 3454us (3795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664304.805082:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788664304.818030:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664304.818185:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119458176 00000100:00100000:1.0:1788664304.818199:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119458176 00000100:00100000:1.0:1788664304.818286:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:1.0:1788664304.818298:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+60:11371:x1875550119458176:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:1.0:1788664304.818706:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dfec lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664304.818737:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dfec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664304.818753:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dfec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788664304.819069:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788664304.819248:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+60:11371:x1875550119458176:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 949us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664304.819258:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:1.0:1788664304.825549:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664304.825681:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119458304 00000100:00100000:3.0:1788664304.825694:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119458304 00000100:00100000:2.0:1788664304.826156:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:2.0:1788664304.826172:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+60:11371:x1875550119458304:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664304.826203:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664304.826230:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dff3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d40c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.826307:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dfec lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.826562:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dff3 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d40c expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.826596:0:6512:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dfec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.826612:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dff3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d40c expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.826629:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:2.0:1788664304.826633:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788664304.826637:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dff3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d40c expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.826646:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d200, rc 0) 00000100:00100000:2.0:1788664304.826730:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:11371:x1875550119458304:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 562us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664304.826738:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 123 00010000:00010000:3.0:1788664305.086285:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664305.216127:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140508416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664305.216242:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664305.216899:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140508416 00000100:00100000:3.0:1788664305.216914:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140508416 00000100:00100000:3.0:1788664305.217066:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788664305.217080:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140508416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664305.217200:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788664305.221004:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140508416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3917us (4751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.221020:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788664305.221323:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140508416:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788664305.278377:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788664305.278393:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788664305.278467:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788664305.278479:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788664305.278669:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304096300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1875550140508544:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788664305.279286:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788664305.288378:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304096300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1875550140508544:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788664305.289262:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664305.289520:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119458432 00000100:00100000:3.0:1788664305.289533:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119458432 00000100:00100000:3.0:1788664305.289643:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:3.0:1788664305.289656:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:11372:x1875550119458432:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788664305.289704:0:6511:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:0.0:1788664305.289971:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664305.290104:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:11372:x1875550119458432:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 449us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.290115:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:1.0:1788664305.295767:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664305.298080:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119458560 00000100:00100000:3.0:1788664305.298099:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119458560 00000100:00100000:3.0:1788664305.298193:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:3.0:1788664305.298206:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:11372:x1875550119458560:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788664305.298516:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dffa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.298552:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dffa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.298604:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dffa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.298624:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e001 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.298631:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e001 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.298637:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e001 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.298665:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e008 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.298676:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.298683:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664305.298754:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788664305.298759:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788664305.299035:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299052:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dffa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299060:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dffa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299082:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dffa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299089:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ba00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664305.299094:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dffa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299103:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dffa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299118:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c4350d6600) 00010000:00010000:3.0:1788664305.299122:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664305.299128:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dffa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299136:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413dffa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299154:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e001 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299160:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e001 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299167:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e001 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299172:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502be00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664305.299175:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e001 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299192:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e001 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299201:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff93c4350d0700) 00010000:00010000:3.0:1788664305.299204:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664305.299207:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e001 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299213:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e001 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299232:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299238:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e008 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299244:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e008 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299249:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664305.299252:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e008 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299258:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e008 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.299266:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:3.0:1788664305.299268:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664305.299271:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e008 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.303151:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e008 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664305.303314:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:11372:x1875550119458560:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 5102us (7556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.303325:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:1.0:1788664305.311328:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664305.313460:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119458816 00000100:00100000:0.0:1788664305.313482:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119458816 00000100:00100000:0.0:1788664305.313588:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:0.0:1788664305.313600:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:11372:x1875550119458816:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664305.313627:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664305.313656:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e00f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d413 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.313860:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e016 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.313900:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e016 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.313915:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e016 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664305.313931:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788664305.314046:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e016 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.314056:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e016 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.314063:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e016 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.314070:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664305.314075:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e016 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.314083:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e016 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.314097:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:0.0:1788664305.314101:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788664305.314106:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e016 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.314113:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e016 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.314165:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e00f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d413 expref: 63 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.314184:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c4350d6600) 00010000:00010000:0.0:1788664305.314187:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788664305.314191:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e00f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d413 expref: 63 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.314203:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957200, rc 0) 00000100:00100000:0.0:1788664305.314305:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+62:11372:x1875550119458816:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 706us (2991us total) trans 4294967400 rc 301/301 00000100:00100000:0.0:1788664305.314313:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:0.0:1788664305.323661:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664305.323757:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119458944 00000100:00100000:2.0:1788664305.323798:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119458944 00000100:00100000:2.0:1788664305.323881:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:2.0:1788664305.323894:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+62:11372:x1875550119458944:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788664305.323980:0:9524:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788664305.324160:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+62:11372:x1875550119458944:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 267us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664305.324168:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:1.0:1788664305.336127:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664305.336399:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119459200 00000100:00100000:3.0:1788664305.336416:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119459200 00000100:00100000:3.0:1788664305.336504:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:3.0:1788664305.336518:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+62:11372:x1875550119459200:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664305.336553:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664305.336558:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788664305.336606:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413dfb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3f7 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.336643:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:3.0:1788664305.336649:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664305.336669:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e024 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d41a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788664305.337693:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788664305.338065:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e02b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.338083:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e02b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.338095:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e02b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.338160:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e024 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d41a expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.338177:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e02b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d41a expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.338187:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93c4130a6200) 00010000:00010000:2.0:1788664305.338190:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664305.338209:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0da00, rc 0) 00000100:00100000:2.0:1788664305.338648:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+63:11372:x1875550119459200:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 2130us (2531us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788664305.338659:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:3.0:1788664305.346447:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664305.346515:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119459456 00000100:00100000:2.0:1788664305.346530:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119459456 00000100:00100000:2.0:1788664305.346619:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:2.0:1788664305.346631:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+63:11372:x1875550119459456:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788664305.346714:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664305.346752:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e02b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d41a expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.346816:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93c4130a6200) 00010000:00010000:2.0:1788664305.346831:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664305.346861:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e039 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.346945:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e039 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.346960:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e039 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.349714:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e040 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xfb14070c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.349743:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfb14070c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.349758:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfb14070c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.349856:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e039 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.349864:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e039 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.349871:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e039 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.349878:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ca00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664305.349882:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e039 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.349890:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e039 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.349903:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:2.0:1788664305.349906:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664305.349910:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e039 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.349917:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e039 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.349933:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfb14070c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.349940:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e040 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfb14070c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.349946:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e040 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfb14070c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.350024:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664305.350028:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e040 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfb14070c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.350034:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e040 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfb14070c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.350044:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xfb14070c (ffff93c4130a6f00) 00010000:00010000:2.0:1788664305.350047:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664305.350050:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e040 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfb14070c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.350056:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e040 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfb14070c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.351229:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+62:11372:x1875550119459456:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 4592us (4789us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788664305.351240:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:0.0:1788664305.362640:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664305.362860:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119459584 00000100:00100000:1.0:1788664305.362874:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119459584 00000100:00100000:1.0:1788664305.362956:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:1.0:1788664305.362969:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+62:11372:x1875550119459584:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664305.363000:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664305.363050:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e047 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d421 expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.363099:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e04e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.363117:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e04e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.363133:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e04e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.363269:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e047 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d421 expref: 64 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.363305:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e04e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d421 expref: 63 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.363316:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93c3027e5600) 00010000:00010000:1.0:1788664305.363319:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788664305.363324:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b84a00, rc 0) 00000100:00100000:1.0:1788664305.363410:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+63:11372:x1875550119459584:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 444us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664305.363419:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:1.0:1788664305.374110:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664305.374244:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119459840 00000100:00100000:2.0:1788664305.374258:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119459840 00000100:00100000:2.0:1788664305.374346:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:2.0:1788664305.374357:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+63:11372:x1875550119459840:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788664305.374473:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e055 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.374495:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e055 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.374510:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e055 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788664305.374752:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788664305.374763:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 400511991468ns, next at 401511988283ns, rc = 0 00000004:00010000:2.0:1788664305.375554:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001767b09 reply state 00000000f9132cb7 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e055 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.375589:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e055 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.375599:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93c3027e5600) 00010000:00010000:2.0:1788664305.375602:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788664305.375607:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788664305.376449:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+65:11372:x1875550119459840:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 2084us (2346us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788664305.376461:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:3.0:1788664305.383863:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664305.384250:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119459968 00000100:00100000:2.0:1788664305.384264:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119459968 00000100:00100000:2.0:1788664305.384358:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:2.0:1788664305.384371:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+65:11372:x1875550119459968:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664305.384408:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664305.384435:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e05c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d428 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.384526:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e05c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d428 expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.384543:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e05c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d428 expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.384596:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93c3027e5600) 00010000:00010000:2.0:1788664305.384599:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788664305.384603:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0ca00, rc 0) 00000100:00100000:2.0:1788664305.384881:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+66:11372:x1875550119459968:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 501us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664305.384895:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:0.0:1788664305.396092:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664305.396207:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119460096 00000100:00100000:3.0:1788664305.396217:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119460096 00000100:00100000:3.0:1788664305.396288:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:3.0:1788664305.396298:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2390:x1875550119460096:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788664305.396615:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664305.396652:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2390:x1875550119460096:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 355us (568us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788664305.396660:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1788664305.401414:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664305.401513:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119460352 00000100:00100000:1.0:1788664305.401523:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119460352 00000100:00100000:1.0:1788664305.401589:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:1.0:1788664305.401600:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+66:11372:x1875550119460352:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788664305.401947:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+67:11372:x1875550119460352:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 349us (543us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1788664305.401955:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:2.0:1788664305.412054:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664305.413614:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119460608 00000100:00100000:0.0:1788664305.413627:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119460608 00000100:00100000:1.0:1788664305.416469:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:1.0:1788664305.416483:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+67:11372:x1875550119460608:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788664305.416627:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+67:11372:x1875550119460608:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 146us (4582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664305.416635:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:2.0:1788664305.427125:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664305.427208:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119460736 00000100:00100000:1.0:1788664305.427219:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119460736 00000100:00100000:1.0:1788664305.427279:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:1.0:1788664305.427289:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+67:11372:x1875550119460736:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664305.427316:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664305.427335:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e063 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d42f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.427412:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e06a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.427428:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e06a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.427439:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e06a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664305.427495:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664305.427517:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e06a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.427560:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e063 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d42f expref: 69 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.427589:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e06a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d42f expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.427597:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93c3027e5600) 00010000:00010000:1.0:1788664305.427600:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788664305.427603:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b84800, rc 0) 00000100:00100000:1.0:1788664305.427665:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+68:11372:x1875550119460736:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 377us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664305.427672:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:0.0:1788664305.430531:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664305.430733:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119460864 00000100:00100000:3.0:1788664305.430743:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119460864 00000100:00100000:3.0:1788664305.430897:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:3.0:1788664305.430913:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2391:x1875550119460864:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664305.430930:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664305.430950:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091bebf73/0xcd11f61c1413e071 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d436 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788664305.430975:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cd9f1, blocks: 0x0 00010000:00010000:3.0:1788664305.430994:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1788664305.430998:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664305.431007:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091bebf73/0xcd11f61c1413e071 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d436 expref: 10 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.431023:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091bebf73/0xcd11f61c1413e071 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d436 expref: 10 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.431035:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502be00, rc 0) 00000100:00100000:3.0:1788664305.431088:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:2391:x1875550119460864:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 182us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.431095:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:2.0:1788664305.435330:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664305.435632:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119461120 00000100:00100000:3.0:1788664305.435655:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119461120 00000100:00100000:3.0:1788664305.435750:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:3.0:1788664305.435761:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+68:11372:x1875550119461120:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788664305.435920:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+68:11372:x1875550119461120:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 160us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.435928:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:0.0:1788664305.439191:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664305.439323:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119461248 00000100:00100000:3.0:1788664305.439334:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119461248 00000100:00100000:3.0:1788664305.439390:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:3.0:1788664305.439401:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:11372:x1875550119461248:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664305.439419:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664305.439438:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413e078 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d43d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.439477:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091bebf73/0xcd11f61c1413e071 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d436 expref: 11 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.439486:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664305.439491:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664305.439496:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413e078 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d43d expref: 11 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.439532:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091bebf73/0xcd11f61c1413e071 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d436 expref: 11 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.439546:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091bebf73/0xcd11f61c1413e071 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d436 expref: 11 pid: 8426 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664305.439589:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875550140508672:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664305.439687:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c407800240 going to sleep for 11 seconds 00000100:00100000:0.0:1788664305.443686:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664305.443843:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875550140508672:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664305.443884:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413e078 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d43d expref: 11 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.443910:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502ba00, rc 0) 00000100:00100000:3.0:1788664305.443965:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:11372:x1875550119461248:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 4566us (4782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.443974:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:1.0:1788664305.444152:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119461376 00000100:00100000:1.0:1788664305.444160:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119461376 00010000:00010000:1.0:1788664305.444190:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091bebf73/0xcd11f61c1413e071 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d436 expref: 11 pid: 8426 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664305.444222:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:1.0:1788664305.444229:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:2391:x1875550119461376:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664305.444242:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664305.444262:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091bebf73/0xcd11f61c1413e071 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d436 expref: 11 pid: 8426 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.444285:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091bebf73/0xcd11f61c1413e071 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d436 expref: 11 pid: 8426 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.444330:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091bebf73/0xcd11f61c1413e071 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d436 expref: 11 pid: 8426 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.444344:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664305.444349:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664305.444356:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413e078 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d43d expref: 10 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.444365:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413e078 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d43d expref: 10 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.444399:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413e078 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d43d expref: 10 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664305.444412:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6496:1875550140508800:192.168.203.52@tcp:105: 00000100:00100000:1.0:1788664305.444465:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664305.451348:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6496:1875550140508800:192.168.203.52@tcp:105: 00010000:00010000:1.0:1788664305.451375:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664305.451437:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:2391:x1875550119461376:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 7207us (7759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664305.451448:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:0.0:1788664305.457166:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664305.457384:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119461504 00000100:00100000:2.0:1788664305.457394:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119461504 00002000:00100000:2.0:1788664305.457444:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff93c303add180 x1875550119461504/t0(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:611/0 lens 504/0 e 0 to 0 dl 1788664316 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664305.457455:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c303add180 with x1875550119461504 ext(0->12) 00002000:00010000:2.0:1788664305.457460:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c303add180 00000100:00100000:2.0:1788664305.457534:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:2.0:1788664305.457544:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:2390:x1875550119461504:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788664305.462444:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+12:2390:x1875550119461504:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 4891us (5279us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788664305.462457:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00002000:00100000:2.0:1788664305.462471:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff93c303add180 x1875550119461504/t4294967309(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:611/0 lens 504/448 e 0 to 0 dl 1788664316 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664305.462481:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c303add180 with x1875550119461504 ext(0->12) 00002000:00010000:2.0:1788664305.462499:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c303add180 00000100:00100000:0.0:1788664305.467624:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664305.467706:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119461632 00000100:00100000:3.0:1788664305.467716:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119461632 00000100:00100000:3.0:1788664305.467996:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00100000:2.0:1788664305.469066:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+68:11372:x1875550119461632:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788664305.471983:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:2.0:1788664305.471997:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1788664305.472032:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788664305.472052:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c303af99c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788664305.472057:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c403948800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c303af9180 00000020:00080000:2.0:1788664305.472061:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c403948b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c4116a9400 00000020:00080000:2.0:1788664305.472108:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c403ce8cc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788664305.472111:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c4225ff500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c411902240 00000020:00080000:2.0:1788664305.472114:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c4225ffb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c43cf8e400 00000020:00080000:2.0:1788664305.472144:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788664305.472224:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788664305.472361:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:11372:x1875550119461632:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 4351us (4741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.472530:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140508928:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788664305.472602:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664305.472654:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140509056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788664305.472679:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664305.472714:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140508928 00000100:00100000:3.0:1788664305.472721:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140508928 00000100:00100000:3.0:1788664305.472765:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140509056 00000100:00100000:3.0:1788664305.472768:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140509056 00000100:00100000:3.0:1788664305.472807:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788664305.472814:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3639:x1875550140508928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788664305.472854:0:9895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1788664305.472892:0:9895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080653c58/0xcd11f61c1413e07f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.472913:0:9895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413de33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d395 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.472921:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788664305.472925:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664305.472930:0:9895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080653c58/0xcd11f61c1413e07f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.472961:0:9895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413de33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d395 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.472977:0:9895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413de33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d395 expref: 11 pid: 8428 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664305.472990:0:9895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9895:1875550140509184:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664305.473034:0:9895:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c407800240 going to sleep for 11 seconds 00000100:00100000:3.0:1788664305.473052:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788664305.473060:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3636:x1875550140509056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788664305.473158:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788664305.473162:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788664305 00002000:00010000:3.0:1788664305.473164:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788664305.473166:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788664305 -> 1788664305 00002000:00010000:3.0:1788664305.473168:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788664305.473211:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3636:x1875550140509056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 152us (531us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788664305.473218:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788664305.473238:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788664305.473266:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c303a92680/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788664305.473271:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140509056:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788664305.475029:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dd7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.475047:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dd7d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.475074:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dd7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.475080:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664305.475086:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dd7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.475094:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dd7d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.475111:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93c3038d3b00) 00010000:00010000:0.0:1788664305.475114:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664305.475118:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dd7d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.475124:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413dd7d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476314:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413de25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476323:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413de25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476329:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413de25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476334:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664305.476337:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413de25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476358:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413de25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476370:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93c4350d0e00) 00010000:00010000:0.0:1788664305.476373:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664305.476376:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413de25 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476383:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413de25 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476400:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dea3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476406:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dea3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476410:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dea3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476415:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ac00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664305.476418:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dea3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476423:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dea3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476429:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c4350d0a00) 00010000:00010000:0.0:1788664305.476432:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664305.476434:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dea3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476445:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413dea3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476457:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413dec6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476462:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413dec6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476467:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413dec6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476472:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502bc00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664305.476474:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413dec6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476480:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413dec6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476487:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c4350d0a00) 00010000:00010000:0.0:1788664305.476490:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664305.476492:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413dec6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476497:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413dec6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476509:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476514:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476525:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476529:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956c00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664305.476532:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476538:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476545:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:0.0:1788664305.476547:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664305.476550:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df98 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476556:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413df98 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476578:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e055 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476585:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e055 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476590:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e055 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476595:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664305.476598:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e055 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476612:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e055 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476622:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93c3027e5600) 00010000:00010000:0.0:1788664305.476625:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788664305.476628:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e055 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.476633:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e055 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664305.476734:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140509312:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788664305.476849:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664305.478056:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140509312 00000100:00100000:0.0:1788664305.478067:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140509312 00000100:00100000:0.0:1788664305.478114:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788664305.478122:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3637:x1875550140509312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788664305.478160:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:0.0:1788664305.478195:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9cd9f0, atime: 0x6a9cd9f0, ctime: 0x6a9cd9f0, blocks: 0x8 00010000:00010000:0.0:1788664305.478203:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413e086 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.478220:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1788664305.478224:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664305.478230:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413e086 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.478246:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413e086 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.478276:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413e086 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.478284:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413e086 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.478309:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788664305.478490:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3637:x1875550140509312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 367us (1640us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788664305.478498:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1788664305.479184:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c43526dc00/2, rc 0, transno 4294967305 00000100:00100000:3.0:1788664305.479193:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43526dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140509312:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788664305.479243:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664305.479250:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413e086 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.479261:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957e00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664305.479265:0:7453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413e086 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.479275:0:7453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413e086 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.479292:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413e086 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.479299:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413e086 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.479333:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664305.479336:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664305.479338:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664305.481624:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664305.481814:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119461760 00000100:00100000:0.0:1788664305.481824:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119461760 00000100:00100000:0.0:1788664305.481887:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:0.0:1788664305.481897:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+12:2390:x1875550119461760:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788664305.482670:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664305.483624:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119461888 00000100:00100000:0.0:1788664305.483635:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119461888 00010000:00010000:0.0:1788664305.483681:0:10332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413de33 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d395 expref: 13 pid: 8428 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664305.483722:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:0.0:1788664305.483732:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c412c72450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:2391:x1875550119461888:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664305.483744:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664305.483750:0:10332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413de33 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d395 expref: 13 pid: 8428 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.483799:0:10332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413de33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d395 expref: 13 pid: 8428 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.483851:0:10332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664305.483857:0:10332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664305.483864:0:10332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080653c58/0xcd11f61c1413e07f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.483874:0:10332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080653c58/0xcd11f61c1413e07f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.483897:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664305.483960:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c412c72450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:2391:x1875550119461888:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 229us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664305.483968:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:2.0:1788664305.484481:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 136 00000001:00080000:3.0:1788664305.488027:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1788664305.488044:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788664305.489285:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1788664305.489307:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:1.0:1788664305.492020:0:9895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413de33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d395 expref: 7 pid: 8428 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664305.492071:0:9895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9895:1875550140509184:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664305.492097:0:9895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080653c58/0xcd11f61c1413e07f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.492110:0:9895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080653c58/0xcd11f61c1413e07f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.492118:0:9895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080653c58/0xcd11f61c1413e07f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.492141:0:9895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080653c58/0xcd11f61c1413e07f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.492151:0:9895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080653c58/0xcd11f61c1413e07f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.492181:0:9895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664305.492278:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664305.492286:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080653c58/0xcd11f61c1413e07f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.492295:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a800 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664305.492300:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080653c58/0xcd11f61c1413e07f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.492309:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080653c58/0xcd11f61c1413e07f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.492328:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080653c58/0xcd11f61c1413e07f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.492335:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080653c58/0xcd11f61c1413e07f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.492352:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664305.492354:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664305.492365:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664305.494698:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3639:x1875550140508928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21876us (22087us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788664305.494714:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788664305.494858:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788664305.494864:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:3.0:1788664305.494887:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c303a92680, transno 4294967310 00000100:00100000:3.0:1788664305.494907:0:3639:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93c303a92d80 x1875550140508928/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788664321 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788664305.494918:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c303a92d80/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788664305.494924:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140508928:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788664305.497442:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2390:x1875550119461760:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 15535us (15815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664305.497454:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:2.0:1788664305.500430:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664305.500521:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119462144 00000100:00100000:0.0:1788664305.500531:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119462144 00000100:00100000:0.0:1788664305.500599:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:0.0:1788664305.500609:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+16:11372:x1875550119462144:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788664305.500666:0:9169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664305.500699:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e06a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d42f expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.500733:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93c3027e5600) 00010000:00010000:0.0:1788664305.500738:0:9169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664305.501033:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e08d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.501049:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e08d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.501058:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e08d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664305.501181:0:9169:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a79d5f78 reply state 000000003de48489 transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e08d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.501194:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e08d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.501201:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93c3027e5600) 00010000:00010000:0.0:1788664305.501203:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788664305.501206:0:9169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788664305.501314:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:11372:x1875550119462144:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 706us (891us total) trans 4294967404 rc 0/0 00000100:00100000:0.0:1788664305.501321:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:3.0:1788664305.504048:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664305.504205:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119462272 00000100:00100000:1.0:1788664305.504218:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119462272 00000100:00100000:1.0:1788664305.504276:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:1.0:1788664305.504287:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119462272:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788664305.504463:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788664305.504466:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788664305 -> 1788664304 00002000:00010000:1.0:1788664305.504469:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788664304 00002000:00010000:1.0:1788664305.504471:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788664305 -> 1788664304 00002000:00010000:1.0:1788664305.504473:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788664305.504539:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119462272:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 253us (505us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788664305.504546:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:1.0:1788664305.507626:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664305.508003:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119462528 00000100:00100000:3.0:1788664305.508014:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119462528 00000100:00100000:3.0:1788664305.508117:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:3.0:1788664305.508127:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:11372:x1875550119462528:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788664305.508203:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e094 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.508230:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e04e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d421 expref: 17 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.508246:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e094 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.508278:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e04e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d421 expref: 17 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.508293:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e04e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d421 expref: 17 pid: 9169 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664305.508326:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a92300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140509440:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664305.508535:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c407800240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664305.512759:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664305.512949:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119462656 00000100:00100000:0.0:1788664305.512959:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119462656 00010000:00010000:0.0:1788664305.513000:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e04e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d421 expref: 18 pid: 9169 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664305.513048:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:0.0:1788664305.513070:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:2390:x1875550119462656:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664305.513085:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664305.513091:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e04e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d421 expref: 18 pid: 9169 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.513105:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e04e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d421 expref: 18 pid: 9169 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.513128:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93c3027e5600) 00010000:00010000:0.0:1788664305.513133:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e094 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.513143:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e094 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.513152:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e094 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.513170:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664305.513325:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:2390:x1875550119462656:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 167us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664305.513334:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00010000:00010000:3.0:1788664305.514215:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e04e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d421 expref: 17 pid: 9169 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664305.514234:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a92300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140509440:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664305.514257:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e094 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.514266:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e094 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.514272:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e094 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.514324:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e094 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.514331:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e094 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.514338:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e094 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.514343:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664305.514348:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e094 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.514371:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e094 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.514383:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93c3027e5600) 00010000:00010000:3.0:1788664305.514387:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788664305.514390:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e094 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.514396:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e094 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664305.514462:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+16:11372:x1875550119462528:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 6336us (6843us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788664305.514470:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:2.0:1788664305.520658:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664305.520843:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119462784 00000100:00100000:1.0:1788664305.520853:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119462784 00000100:00100000:1.0:1788664305.520912:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:1.0:1788664305.520922:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2392:x1875550119462784:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788664305.520970:0:9895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e09b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.520993:0:9895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413e078 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d43d expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.521001:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664305.521005:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664305.521009:0:9895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e09b lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.521044:0:9895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413e078 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d43d expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.521078:0:9895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413e078 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d43d expref: 7 pid: 8429 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664305.521093:0:9895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c405329f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9895:1875550140509568:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664305.521188:0:9895:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303af9240 going to sleep for 11 seconds 00000100:00100000:1.0:1788664305.526130:0:9895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c405329f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9895:1875550140509568:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664305.526169:0:9895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e09b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.528192:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664305.528287:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119462912 00000100:00100000:1.0:1788664305.528297:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119462912 00010000:00010000:1.0:1788664305.528336:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413e078 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d43d expref: 8 pid: 8429 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664305.528382:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:1.0:1788664305.528393:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2391:x1875550119462912:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664305.528409:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664305.528430:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413e078 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d43d expref: 8 pid: 8429 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.528443:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413e078 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d43d expref: 8 pid: 8429 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.528468:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413e078 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d43d expref: 8 pid: 8429 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.528501:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664305.528506:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664305.528512:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e09b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.528522:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e09b lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.528557:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664305.528625:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119462912:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 233us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664305.528632:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00010000:00010000:3.0:1788664305.529095:0:9895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e09b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.529106:0:9895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e09b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.529128:0:9895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e09b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.529136:0:9895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e09b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.529145:0:9895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e09b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.529161:0:9895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85000 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664305.529166:0:9895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e09b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.529175:0:9895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e09b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.529188:0:9895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e09b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.529197:0:9895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e09b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664305.529247:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119462784:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 8325us (8598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.529254:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:0.0:1788664305.532947:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664305.533084:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119463168 00000100:00100000:2.0:1788664305.533093:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119463168 00000100:00100000:2.0:1788664305.533148:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:2.0:1788664305.533158:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+16:11372:x1875550119463168:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788664305.533246:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.533264:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413df91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3e9 expref: 16 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.533275:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0a2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.533310:0:9524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413df91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3e9 expref: 16 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.533324:0:9524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413df91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3e9 expref: 16 pid: 9524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.533337:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4012ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9524:1875550140509696:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664305.533411:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42248da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664305.539003:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4012ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9524:1875550140509696:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788664305.539035:0:9524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664305.549185:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664305.549541:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119463296 00000100:00100000:3.0:1788664305.549552:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119463296 00010000:00010000:3.0:1788664305.549605:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413df91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3e9 expref: 17 pid: 9524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664305.549647:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:3.0:1788664305.549658:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303740700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:2390:x1875550119463296:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664305.549673:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664305.549695:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413df91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3e9 expref: 17 pid: 9524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.549707:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413df91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3e9 expref: 17 pid: 9524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.549730:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413df91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d3e9 expref: 17 pid: 9524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.549746:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:3.0:1788664305.549753:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dff3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d40c expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.549762:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.549769:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.549949:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.549972:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664305.550030:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303740700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+16:2390:x1875550119463296:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 374us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.550037:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00010000:00010000:0.0:1788664305.550812:0:9524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.550850:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.551027:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0a9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.551040:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e05c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d428 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.551048:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0a9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.551080:0:9524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e05c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d428 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.551094:0:9524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e05c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d428 expref: 16 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664305.551108:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9524:1875550140509824:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788664305.551192:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664305.564759:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664305.565083:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119463424 00000100:00100000:0.0:1788664305.565093:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119463424 00010000:00010000:0.0:1788664305.565145:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e05c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d428 expref: 17 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664305.565178:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:0.0:1788664305.565188:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:2391:x1875550119463424:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664305.565216:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664305.565223:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e05c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d428 expref: 17 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.565236:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e05c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d428 expref: 17 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.565258:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93c3027e5600) 00010000:00010000:0.0:1788664305.565263:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0a9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.565274:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.565282:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0a9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.565299:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664305.565361:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:2391:x1875550119463424:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 174us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664305.565368:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00010000:00010000:2.0:1788664305.567124:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e05c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d428 expref: 16 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.567157:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9524:1875550140509824:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788664305.567180:0:9524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.567189:0:9524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.567195:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664305.567318:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1788664305.567428:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:2.0:1788664305.567465:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788664305.567561:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4012ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9524:1875550140509952:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788664305.567640:0:9524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664305.567682:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42248df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664305.567854:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140509952 00000100:00100000:1.0:1788664305.567862:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140509952 00000100:00100000:1.0:1788664305.567910:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788664305.567921:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9524:x1875550140509952:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788664305.568001:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9524:x1875550140509952:12345-0@lo:1000:mdt00_004.0 Request processed in 82us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664305.568009:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788664305.568272:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4012ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9524:1875550140509952:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1788664305.568401:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:0.0:1788664305.568450:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9524:1875550140510080:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788664305.568482:0:9524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664305.568510:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3010869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664305.568581:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140510080 00000100:00100000:3.0:1788664305.568586:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140510080 00000100:00100000:3.0:1788664305.568622:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788664305.568640:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9524:x1875550140510080:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788664305.568746:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:9524:x1875550140510080:12345-0@lo:1000:mdt00_004.0 Request processed in 106us (262us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788664305.568753:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788664305.569676:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9524:1875550140510080:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788664305.569719:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.569739:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0a9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.569746:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0a9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.569753:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957e00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664305.569757:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0a9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.569766:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0a9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.569825:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93c3027e5600) 00010000:00010000:0.0:1788664305.569829:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664305.569840:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0a9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.569847:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0a9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.569874:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dfec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.569880:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dfec lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.569886:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dfec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.569892:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664305.569903:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dfec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.569909:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dfec lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.569918:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:0.0:1788664305.569921:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664305.569927:0:9524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dff3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d40c expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.569939:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dff3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d40c expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.569949:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dff3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d40c expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.569986:0:9524:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dff3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d40c expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664305.570000:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9524:1875550140510208:192.168.203.52@tcp:105: 00000100:00100000:0.0:1788664305.570074:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3010869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664305.574040:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664305.574120:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119463552 00000100:00100000:1.0:1788664305.574136:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119463552 00000100:00100000:1.0:1788664305.574196:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:1.0:1788664305.574205:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:11371:x1875550119463552:12345-192.168.203.52@tcp:49:lfs.0 00000100:00100000:1.0:1788664305.574336:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:11371:x1875550119463552:12345-192.168.203.52@tcp:49:lfs.0 Request processed in 131us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664305.574361:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:2.0:1788664305.574580:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9524:1875550140510208:192.168.203.52@tcp:105: 00010000:00010000:2.0:1788664305.574608:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dfec lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.574618:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413dfec lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.574649:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e0b0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.574666:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e0b0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.574677:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e0b0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.574688:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e0b0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.574694:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e0b0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.574701:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e0b0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.574720:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664305.574724:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e0b0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.574731:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e0b0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.574744:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:2.0:1788664305.574748:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664305.574751:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e0b0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.574757:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e0b0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.574768:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.574806:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0a2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.574812:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.575031:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0da00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664305.575035:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.575043:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0a2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.575061:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:2.0:1788664305.575063:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788664305.575067:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0a2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.575073:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0a2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664305.575280:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:11372:x1875550119463168:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 42120us (42338us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788664305.575290:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 139 00000020:00080000:0.0:1788664305.575295:0:9524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788664305.575423:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788664305.575429:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788664305.576098:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788664305.576111:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788664305.583101:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664305.583172:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119463808 00000100:00100000:0.0:1788664305.583182:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119463808 00000100:00100000:0.0:1788664305.583247:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00100000:0.0:1788664305.583256:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:11371:x1875550119463808:12345-192.168.203.52@tcp:58:lfs.0 00000040:00080000:0.0:1788664305.583439:0:9169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788664305.583539:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:11371:x1875550119463808:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 283us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664305.583547:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00100000:3.0:1788664305.587212:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664305.587536:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119464064 00000100:00100000:1.0:1788664305.587547:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119464064 00000100:00100000:1.0:1788664305.587616:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:1.0:1788664305.587625:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c406b60c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:11372:x1875550119464064:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788664305.587928:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788664305.587960:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:1.0:1788664305.587997:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413e0b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.588014:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413e0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.588026:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413e0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.588035:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413e0b7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.588041:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413e0b7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.588048:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413e0b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664305.588072:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788664305.588174:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c406b60c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:11372:x1875550119464064:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 549us (975us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788664305.588181:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000020:00080000:1.0:1788664305.588186:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788664305.588862:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664305.588870:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413e0b7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.588877:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84e00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664305.588881:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413e0b7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.588888:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413e0b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.588902:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93c3027e5600) 00010000:00010000:3.0:1788664305.588905:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788664305.588909:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413e0b7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.588914:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413e0b7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.588926:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664305.588928:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664305.588929:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664305.647299:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664305.647714:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119464192 00000100:00100000:2.0:1788664305.647725:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119464192 00000100:00100000:2.0:1788664305.647827:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:2.0:1788664305.647915:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:11374:x1875550119464192:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664305.647943:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664305.647964:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e0be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d444 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.648036:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e0c5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.648051:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e0c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.648063:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e0c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.648223:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e0cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.648231:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e0cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.648654:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e0cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.648738:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.648749:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d405 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.648758:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0d3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.649012:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d405 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.649032:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d405 expref: 22 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.649050:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c402f46300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140510336:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664305.649386:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42248dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664305.655382:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664305.656289:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119464448 00000100:00100000:1.0:1788664305.656301:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119464448 00000100:00100000:1.0:1788664305.656373:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:1.0:1788664305.656383:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+23:6160:x1875550119464448:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788664305.656619:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:6160:x1875550119464448:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 235us (1246us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788664305.656626:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1788664305.659019:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c402f46300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140510336:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788664305.659055:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664305.662877:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664305.665266:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119464576 00000100:00100000:0.0:1788664305.665283:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119464576 00010000:00010000:0.0:1788664305.665336:0:10332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d405 expref: 24 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664305.665383:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:0.0:1788664305.665393:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:2391:x1875550119464576:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664305.665409:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664305.665416:0:10332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d405 expref: 24 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.665443:0:10332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d405 expref: 24 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.665467:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413dfde lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d405 expref: 24 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.665506:0:10332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:0.0:1788664305.665512:0:10332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.665521:0:10332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.665530:0:10332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0d3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.665566:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664305.665647:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+23:2391:x1875550119464576:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 254us (2779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664305.665654:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00010000:00010000:2.0:1788664305.665827:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.665843:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664305.665897:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788664305.665902:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664305.665933:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.665946:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.665955:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e0c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.665962:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e0c5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.665968:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e0c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.665974:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ca00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664305.665979:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e0c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.665986:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e0c5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.665996:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:2.0:1788664305.665999:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664305.666001:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e0c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.666008:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e0c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.666017:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e0cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.666022:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e0cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.666035:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e0cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.666039:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664305.666042:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e0cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.666048:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e0cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.666055:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93c4130a6700) 00010000:00010000:2.0:1788664305.666057:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664305.666060:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e0cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.666065:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e0cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.666098:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e0be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d444 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.666110:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d444 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.666116:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:2.0:1788664305.666118:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664305.666120:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0da00, rc 0) 00000100:00100000:2.0:1788664305.666148:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:11374:x1875550119464192:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 18313us (18859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664305.666163:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:1.0:1788664305.726033:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664305.726304:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664305.726341:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140510592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664305.726416:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664305.726493:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140510592 00000100:00100000:3.0:1788664305.726500:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140510592 00000100:00100000:3.0:1788664305.726547:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788664305.726556:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875550140510592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664305.726591:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788664305.727886:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875550140510592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1325us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.727898:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788664305.727947:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c402f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140510720:0@lo:400:kworker.0 00000100:00100000:3.0:1788664305.727998:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664305.728054:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664305.728061:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140510848:0@lo:400:kworker.0 00000100:00100000:3.0:1788664305.728089:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664305.728118:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140510976:0@lo:400:kworker.0 00000100:00100000:3.0:1788664305.728150:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664305.728200:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140510592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664305.728228:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140510848 00000100:00100000:3.0:1788664305.728233:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140510848 00000100:00100000:3.0:1788664305.728276:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788664305.728284:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140510848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664305.728332:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140510848:12345-0@lo:400:kworker.0 Request processed in 49us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.728339:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788664305.728363:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140510848:0@lo:400:kworker.0 00000100:00100000:3.0:1788664305.728429:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140510720 00000100:00100000:3.0:1788664305.728433:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140510720 00000100:00100000:3.0:1788664305.728459:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140510976 00000100:00100000:3.0:1788664305.728462:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140510976 00000100:00100000:3.0:1788664305.728481:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788664305.728487:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140510720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664305.728524:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140510720:12345-0@lo:400:kworker.0 Request processed in 37us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.728531:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788664305.728554:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c402f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140510720:0@lo:400:kworker.0 00000100:00100000:3.0:1788664305.728583:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788664305.728589:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140510976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664305.728624:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140510976:12345-0@lo:400:kworker.0 Request processed in 36us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.728630:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788664305.729268:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140510976:0@lo:400:kworker.0 00000100:00100000:1.0:1788664305.730975:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140510464:0@lo:400:kworker.0 00000100:00100000:1.0:1788664305.731068:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664305.731507:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140510464 00000100:00100000:3.0:1788664305.731516:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140510464 00000100:00100000:3.0:1788664305.731606:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788664305.731616:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140510464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664305.731696:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140510464:12345-0@lo:400:kworker.0 Request processed in 81us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.731703:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788664305.731866:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140510464:0@lo:400:kworker.0 00000100:00100000:0.0:1788664305.732180:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140511360:0@lo:400:kworker.0 00000100:00100000:0.0:1788664305.732224:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664305.732319:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140511104:0@lo:400:kworker.0 00000100:00100000:1.0:1788664305.732350:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664305.732371:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140511616:0@lo:400:kworker.0 00000100:00100000:1.0:1788664305.732392:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664305.732411:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664305.732417:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140511488:0@lo:400:kworker.0 00000100:00100000:1.0:1788664305.732439:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664305.732463:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140511104 00000100:00100000:1.0:1788664305.732468:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140511104 00000100:00080000:1.0:1788664305.732494:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664305.732528:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140511616 00000100:00100000:1.0:1788664305.732539:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140511616 00000100:00100000:1.0:1788664305.732580:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140511488 00000100:00100000:1.0:1788664305.732583:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140511488 00000100:00100000:1.0:1788664305.732602:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788664305.732608:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140511104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664305.732665:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140511104:12345-0@lo:400:kworker.0 Request processed in 57us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664305.732672:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788664305.732687:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788664305.732693:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140511616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664305.732719:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140511616:12345-0@lo:400:kworker.0 Request processed in 27us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664305.732725:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788664305.732736:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788664305.732741:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140511488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664305.732765:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140511488:12345-0@lo:400:kworker.0 Request processed in 25us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664305.732793:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00080000:1.0:1788664305.732807:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788664305.732809:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788664305.732963:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140511488:0@lo:400:kworker.0 00000100:00100000:1.0:1788664305.732978:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140511104:0@lo:400:kworker.0 00010000:00080000:1.0:1788664305.732987:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b72d80 x1875550140511616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664305.732995:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140511616:0@lo:400:kworker.0 00000100:00100000:0.0:1788664305.733271:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788664305.733280:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140511232:0@lo:400:kworker.0 00000100:00100000:0.0:1788664305.733307:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664305.733322:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140511744:0@lo:400:kworker.0 00000100:00100000:0.0:1788664305.733343:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664305.733383:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140511232 00000100:00100000:1.0:1788664305.733388:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140511232 00000100:00100000:1.0:1788664305.733420:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788664305.733428:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140511232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664305.733462:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140511232:12345-0@lo:400:kworker.0 Request processed in 35us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664305.733467:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:1.0:1788664305.733480:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664305.740644:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140511360 00000100:00100000:2.0:1788664305.740664:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140511360 00000100:00100000:2.0:1788664305.740757:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140511744 00000100:00100000:2.0:1788664305.740761:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140511744 00000100:00100000:2.0:1788664305.740827:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788664305.740849:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140511360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664305.740954:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140511360:12345-0@lo:400:kworker.0 Request processed in 118us (8729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664305.740970:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1788664305.740982:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664305.740986:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1788664305.740987:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664305.740992:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140511744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664305.741052:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140511744:12345-0@lo:400:kworker.0 Request processed in 60us (7707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664305.741058:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788664305.744419:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140511744:0@lo:400:kworker.0 00000100:00100000:0.0:1788664305.744439:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140511360:0@lo:400:kworker.0 00010000:00080000:0.0:1788664305.744474:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abc380 x1875550140511232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664305.744509:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140511232:0@lo:400:kworker.0 00010000:00010000:3.0:1788664306.110185:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664306.238404:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664306.238431:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140511872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664306.238513:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664306.238610:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140511872 00000100:00100000:0.0:1788664306.238618:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140511872 00000100:00100000:0.0:1788664306.238679:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788664306.238689:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140511872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664306.238713:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1788664306.238763:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140511872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664306.238788:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788664306.239169:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140511872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664306.327375:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664306.327420:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664306.327441:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664306.327464:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664306.327488:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664306.327514:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119465216 00000100:00100000:0.0:1788664306.327523:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119465216 00000100:00100000:0.0:1788664306.327588:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119464832 00000100:00100000:0.0:1788664306.327592:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119464832 00000100:00100000:0.0:1788664306.327612:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119465088 00000100:00100000:0.0:1788664306.327615:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119465088 00000100:00100000:0.0:1788664306.327642:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 323 00000100:00100000:0.0:1788664306.327653:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119465216:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664306.327728:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119465216:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 77us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664306.327737:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 323 00000100:00100000:0.0:1788664306.327758:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 324 00000100:00100000:0.0:1788664306.327806:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119464832:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664306.327837:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119464832:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 33us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664306.327843:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 324 00000100:00100000:0.0:1788664306.327859:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 325 00000100:00100000:0.0:1788664306.327865:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119465088:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664306.327889:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119465088:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664306.327896:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 325 00000100:00100000:3.0:1788664306.330438:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119464704 00000100:00100000:3.0:1788664306.330452:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119464704 00000100:00100000:3.0:1788664306.330505:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 388 00000100:00100000:3.0:1788664306.330515:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119464704:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664306.330594:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119464704:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 80us (3229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664306.330602:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 388 00000100:00100000:3.0:1788664306.330644:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119464960 00000100:00100000:3.0:1788664306.330648:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119464960 00000100:00100000:3.0:1788664306.330678:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:3.0:1788664306.330684:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119464960:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664306.330713:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119464960:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (3295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664306.330720:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00080000:3.0:1788664306.330736:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664306.330741:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664306.330744:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1788664306.624922:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788664306.624931:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788664306.624955:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788664306.624962:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788664306.625129:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304216680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1875550140512000:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788664306.625229:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3010863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664306.632173:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304216680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1875550140512000:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788664306.648150:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664306.648447:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119465344 00000100:00100000:0.0:1788664306.648456:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119465344 00000100:00100000:0.0:1788664306.648541:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:0.0:1788664306.648552:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:11386:x1875550119465344:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788664306.648596:0:6511:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788664306.648721:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:11386:x1875550119465344:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 170us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664306.648729:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:0.0:1788664306.686061:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664306.687226:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119465600 00000100:00100000:1.0:1788664306.687238:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119465600 00000100:00100000:1.0:1788664306.687300:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 143 00000100:00100000:1.0:1788664306.687311:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:11386:x1875550119465600:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664306.687335:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664306.687357:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413e0da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d44b expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664306.687475:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413e0e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664306.687501:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413e0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664306.687512:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413e0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664306.687524:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788664306.687666:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84e00/0xcd11f61c1413e0da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d44b expref: 25 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664306.687684:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413e0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d44b expref: 24 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664306.687693:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:1.0:1788664306.687696:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788664306.687700:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85600, rc 0) 00000100:00100000:1.0:1788664306.687805:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:11386:x1875550119465600:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 495us (1753us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788664306.687811:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 143 00000040:00080000:3.0:1788664306.689383:0:14257:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788664306.689390:0:14257:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788664306.689432:0:14257:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788664306.689439:0:14257:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788664306.702643:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664306.702683:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664306.702754:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119465984 00000100:00100000:0.0:1788664306.702764:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119465984 00000100:00100000:0.0:1788664306.703203:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:0.0:1788664306.703215:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:11386:x1875550119465984:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788664306.703310:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664306.703328:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664306.703340:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664306.703489:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664306.703498:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0ef lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664306.703505:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664306.703511:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957e00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664306.703516:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664306.703523:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0ef lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664306.703534:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:0.0:1788664306.703537:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788664306.703541:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0ef lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664306.703547:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e0ef lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664306.703688:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:11386:x1875550119465984:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 474us (1002us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788664306.703697:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:1.0:1788664306.703840:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119465728 00000100:00100000:1.0:1788664306.703847:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119465728 00000100:00100000:1.0:1788664306.703890:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1788664306.703898:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:2391:x1875550119465728:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664306.703911:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664306.703925:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413e0e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d44b expref: 25 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664306.703950:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:1.0:1788664306.703954:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664306.703979:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:2391:x1875550119465728:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 81us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664306.703986:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000040:00080000:0.0:1788664306.704968:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788664306.704975:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788664306.705439:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788664306.705448:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788664306.718011:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664306.718160:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119466240 00000100:00100000:0.0:1788664306.718171:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119466240 00000100:00100000:0.0:1788664306.718228:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:0.0:1788664306.718238:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:11386:x1875550119466240:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788664306.718450:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:11386:x1875550119466240:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 213us (448us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788664306.718458:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1788664306.752978:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664306.753003:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140512128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664306.753073:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664306.753137:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140512128 00000100:00100000:1.0:1788664306.753144:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140512128 00000100:00100000:1.0:1788664306.753190:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788664306.753200:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140512128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664306.753244:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788664306.753304:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140512128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664306.753311:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788664306.753632:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140512128:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788664307.134066:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664307.262268:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664307.262301:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c402f47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140512256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788664307.262368:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664307.263137:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140512256 00000100:00100000:3.0:1788664307.263161:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140512256 00000100:00100000:3.0:1788664307.263229:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788664307.263240:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140512256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788664307.263288:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664307.263344:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140512256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664307.263351:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788664307.263412:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c402f47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140512256:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788664307.263698:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664307.264814:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664307.264833:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140512384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664307.264893:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664307.264994:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140512384 00000100:00100000:0.0:1788664307.265001:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140512384 00000100:00100000:0.0:1788664307.265061:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788664307.265070:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140512384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664307.265087:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664307.265125:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140512384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664307.265131:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1788664307.265247:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664307.265286:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788664307.265292:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:2.0:1788664307.265323:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c43f8a8a80, transno 4294967302 00000004:00080000:2.0:1788664307.265340:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1788664307.265351:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c43526dc00, transno 4294967305 00000100:00100000:2.0:1788664307.265363:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140512384:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788664308.160266:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788664308.634476:0:14308:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788664308.634486:0:14308:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788664308.634516:0:14308:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788664308.634523:0:14308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788664308.813233:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664308.813492:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119466496 00000100:00100000:0.0:1788664308.813506:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119466496 00000100:00080000:2.0:1788664308.813598:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664308.813609:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:0.0:1788664308.813624:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:11407:x1875550119466496:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664308.813683:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664308.813712:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e0f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d452 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664308.816344:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413e0fd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664308.816368:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413e0fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664308.816380:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413e0fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664308.816412:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788664308.816541:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e0f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d452 expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664308.816575:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413e0fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d452 expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664308.816586:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:1.0:1788664308.816588:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788664308.816592:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85600, rc 0) 00000100:00100000:1.0:1788664308.816669:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+27:11407:x1875550119466496:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 3049us (3448us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788664308.816678:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:2.0:1788664308.821419:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664308.821619:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119466624 00000100:00100000:0.0:1788664308.821629:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119466624 00000100:00100000:0.0:1788664308.821686:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 146 00000100:00100000:0.0:1788664308.821697:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+27:11407:x1875550119466624:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1788664308.821763:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e10b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664308.822175:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e10b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664308.822190:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e10b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664308.822230:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e10b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664308.822237:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e10b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664308.822244:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e10b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664308.822250:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664308.822254:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e10b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664308.822262:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e10b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664308.822289:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:0.0:1788664308.822292:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788664308.822297:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e10b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664308.822304:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e10b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664308.822381:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+27:11407:x1875550119466624:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 686us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664308.822389:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 146 00000100:00100000:0.0:1788664308.941334:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664308.941519:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119466752 00000100:00100000:1.0:1788664308.941529:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119466752 00000100:00100000:1.0:1788664308.941825:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:1.0:1788664308.941837:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2393:x1875550119466752:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:1.0:1788664308.941858:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664308.941882:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5029147/0xcd11f61c1413e112 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d459 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664308.941911:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9cd9f0, atime: 0x6a9cd9f0, ctime: 0x6a9cd9f0, blocks: 0x8 00010000:00010000:1.0:1788664308.941932:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1788664308.941936:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664308.941946:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5029147/0xcd11f61c1413e112 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d459 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664308.941988:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5029147/0xcd11f61c1413e112 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d459 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664308.942000:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b84e00, rc 0) 00000100:00080000:2.0:1788664308.942198:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788664308.942389:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2393:x1875550119466752:12345-192.168.203.52@tcp:101:cat.0 Request processed in 553us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664308.942396:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:3.0:1788664308.950042:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664308.950211:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119466880 00000100:00100000:2.0:1788664308.950221:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119466880 00002000:00100000:2.0:1788664308.950344:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff93c402f46300 x1875550119466880/t0(0) o3->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:614/0 lens 488/0 e 0 to 0 dl 1788664319 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664308.950355:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c402f46300 with x1875550119466880 ext(0->4095) 00002000:00010000:2.0:1788664308.950361:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c402f46300 00000100:00100000:2.0:1788664308.950397:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788664308.950407:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2390:x1875550119466880:12345-192.168.203.52@tcp:3:cat.0 00000100:00100000:2.0:1788664308.950600:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2390:x1875550119466880:12345-192.168.203.52@tcp:3:cat.0 Request processed in 194us (567us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788664308.950608:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00002000:00100000:2.0:1788664308.950615:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff93c402f46300 x1875550119466880/t0(0) o3->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:614/0 lens 488/4536 e 0 to 0 dl 1788664319 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664308.950623:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c402f46300 with x1875550119466880 ext(0->4095) 00002000:00010000:2.0:1788664308.950626:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c402f46300 00010000:00010000:3.0:1788664309.182611:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664310.210516:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664310.334651:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140512512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664310.334749:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664310.339348:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140512512 00000100:00100000:3.0:1788664310.339365:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140512512 00000100:00100000:3.0:1788664310.339433:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788664310.339444:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140512512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664310.339482:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788664310.339582:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140512512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (4832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664310.339589:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788664310.341458:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140512512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664310.859588:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664310.859629:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140512640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664310.859729:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664310.859836:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140512640 00000100:00100000:1.0:1788664310.859846:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140512640 00000100:00100000:1.0:1788664310.859914:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788664310.859927:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875550140512640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664310.859971:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788664310.860024:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875550140512640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664310.860033:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788664310.860092:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140512640:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788664310.862586:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664310.867695:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140513152:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.867828:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664310.867889:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140513664:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.867920:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664310.867942:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140514176:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.867967:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664310.867997:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788664310.868003:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140512768:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.868034:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664310.868055:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140513280:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.868078:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664310.868097:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140513792:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.868118:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664310.868138:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140514304:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.868163:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664310.868193:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140512896:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.868220:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664310.868238:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140513408:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.868260:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664310.868278:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140513920:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.868299:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664310.868317:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788664310.868324:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140513024:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.868367:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664310.868389:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140513536:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.868414:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664310.868431:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140514048:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.868476:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664310.868511:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140513152 00000100:00100000:2.0:1788664310.868521:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140513152 00000100:00100000:2.0:1788664310.868582:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140512896 00000100:00100000:2.0:1788664310.868586:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140512896 00000100:00100000:2.0:1788664310.868597:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140513408 00000100:00100000:2.0:1788664310.868600:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140513408 00000100:00100000:2.0:1788664310.868626:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140513920 00000100:00100000:2.0:1788664310.868629:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140513920 00000100:00100000:2.0:1788664310.868643:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140513536 00000100:00100000:2.0:1788664310.868645:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140513536 00000100:00100000:2.0:1788664310.868660:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140514048 00000100:00100000:2.0:1788664310.868662:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140514048 00000100:00100000:2.0:1788664310.868680:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788664310.868690:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140513152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.868763:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140513152:12345-0@lo:400:kworker.0 Request processed in 75us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664310.868806:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788664310.868827:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788664310.868833:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140512896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.868865:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140512896:12345-0@lo:400:kworker.0 Request processed in 32us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664310.868871:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788664310.868882:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788664310.868895:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140513408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.868923:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140513408:12345-0@lo:400:kworker.0 Request processed in 29us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664310.868929:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788664310.868940:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788664310.868945:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140513920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.868970:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140513920:12345-0@lo:400:kworker.0 Request processed in 25us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664310.868975:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788664310.868986:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788664310.868991:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140513536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869018:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140513536:12345-0@lo:400:kworker.0 Request processed in 27us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664310.869024:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788664310.869035:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788664310.869041:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c302b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140514048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869065:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c302b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140514048:12345-0@lo:400:kworker.0 Request processed in 25us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664310.869070:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788664310.869090:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140513664 00000100:00100000:2.0:1788664310.869095:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140513664 00000100:00100000:2.0:1788664310.869116:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140514176 00000100:00100000:2.0:1788664310.869119:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140514176 00000100:00100000:2.0:1788664310.869132:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140513792 00000100:00100000:2.0:1788664310.869135:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140513792 00000100:00100000:2.0:1788664310.869144:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140514304 00000100:00100000:2.0:1788664310.869146:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140514304 00000100:00100000:2.0:1788664310.869167:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788664310.869173:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140513664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869211:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140513664:12345-0@lo:400:kworker.0 Request processed in 38us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664310.869217:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788664310.869228:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788664310.869233:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140514176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869263:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140514176:12345-0@lo:400:kworker.0 Request processed in 29us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664310.869268:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788664310.869279:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788664310.869284:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140513792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869313:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140513792:12345-0@lo:400:kworker.0 Request processed in 29us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664310.869318:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788664310.869328:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788664310.869333:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43535b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1875550140514304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869362:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43535b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1875550140514304:12345-0@lo:400:kworker.0 Request processed in 28us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664310.869367:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788664310.869391:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140512768 00000100:00100000:2.0:1788664310.869395:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140512768 00000100:00100000:2.0:1788664310.869425:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788664310.869432:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140512768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869462:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140512768:12345-0@lo:400:kworker.0 Request processed in 31us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664310.869474:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788664310.869510:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140513280 00000100:00100000:2.0:1788664310.869513:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140513280 00000100:00100000:2.0:1788664310.869555:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140513024 00000100:00100000:2.0:1788664310.869559:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140513024 00000100:00100000:2.0:1788664310.869573:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788664310.869579:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140513280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869616:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140513280:12345-0@lo:400:kworker.0 Request processed in 38us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664310.869622:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788664310.869633:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788664310.869639:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140513024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869668:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140513024:12345-0@lo:400:kworker.0 Request processed in 29us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664310.869673:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:2.0:1788664310.869720:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664310.869725:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664310.869728:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788664310.869731:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664310.869764:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140512768:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869815:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140513280:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869828:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140513792:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869840:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140514304:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869852:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140513152:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869875:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140513664:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869886:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140514176:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.869939:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140513024:0@lo:400:kworker.0 00010000:00080000:2.0:1788664310.869956:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c422668000 x1875550140513536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664310.869968:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140513536:0@lo:400:kworker.0 00010000:00080000:2.0:1788664310.869980:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a6ca80 x1875550140514048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664310.869989:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140514048:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.870000:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140512896:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.870013:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140513408:0@lo:400:kworker.0 00000100:00100000:2.0:1788664310.870024:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140513920:0@lo:400:kworker.0 00000001:00080000:3.0:1788664310.876909:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1788664310.876933:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1788664310.883558:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1788664310.883596:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c301086000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788664310.883601:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c42277aa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c301086840 00000020:00080000:0.0:1788664310.883604:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c42277a100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c40820ba00 00000020:00080000:0.0:1788664310.883628:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788664310.883706:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788664310.883862:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1788664310.883983:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e08d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664310.884000:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e08d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664310.884031:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e08d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664310.884039:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956c00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664310.884044:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e08d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664310.884054:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e08d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664310.884080:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93c3027e5600) 00010000:00010000:1.0:1788664310.884084:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664310.884090:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e08d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664310.884097:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e08d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788664311.069322:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788664311.232192:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664311.358155:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140514432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664311.358265:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664311.358526:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140514432 00000100:00100000:0.0:1788664311.358548:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140514432 00000100:00100000:0.0:1788664311.358612:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788664311.358624:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140514432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664311.358658:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788664311.358731:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140514432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664311.358740:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788664311.359010:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140514432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664311.450053:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664311.450372:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664311.450407:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664311.450431:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664311.450451:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664311.450484:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664311.450506:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664311.450550:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119467520 00000100:00100000:2.0:1788664311.450559:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119467520 00000100:00100000:2.0:1788664311.450610:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119467392 00000100:00100000:2.0:1788664311.450613:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119467392 00000100:00100000:2.0:1788664311.450634:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:2.0:1788664311.450644:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2393:x1875550119467520:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664311.450716:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2393:x1875550119467520:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 73us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664311.450724:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:2.0:1788664311.450740:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:2.0:1788664311.450747:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119467392:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664311.450950:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119467264 00000100:00100000:1.0:1788664311.450954:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119467264 00000100:00100000:1.0:1788664311.450985:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119467776 00000100:00100000:1.0:1788664311.450988:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119467776 00000100:00100000:1.0:1788664311.451002:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119467136 00000100:00100000:1.0:1788664311.451004:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119467136 00000100:00100000:1.0:1788664311.451015:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119467648 00000100:00100000:1.0:1788664311.451017:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119467648 00000100:00100000:1.0:1788664311.451030:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 332 00000100:00100000:1.0:1788664311.451036:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119467264:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664311.451068:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119467264:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664311.451097:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 332 00000100:00100000:1.0:1788664311.451112:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 333 00000100:00100000:1.0:1788664311.451118:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119467776:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664311.451145:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119467776:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664311.451152:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 333 00000100:00100000:1.0:1788664311.451164:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 334 00000100:00100000:1.0:1788664311.451170:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:2393:x1875550119467136:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664311.451195:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:2393:x1875550119467136:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664311.451201:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 334 00000100:00100000:1.0:1788664311.451212:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 335 00000100:00100000:1.0:1788664311.451217:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119467648:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664311.451241:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119467648:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664311.451248:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 335 00000100:00080000:1.0:1788664311.451289:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788664311.451293:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664311.451295:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788664311.451297:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664311.451935:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119467008 00000100:00100000:0.0:1788664311.451950:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119467008 00000100:00100000:0.0:1788664311.452001:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 390 00000100:00100000:0.0:1788664311.452010:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2393:x1875550119467008:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664311.452054:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2393:x1875550119467008:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 45us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664311.452061:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 390 00000100:00100000:2.0:1788664311.452683:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119467392:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664311.452695:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 138 00000040:00080000:0.0:1788664311.807078:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788664311.807092:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788664311.807118:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788664311.807128:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788664311.876294:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140514560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664311.876402:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664311.876520:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140514560 00000100:00100000:1.0:1788664311.876538:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140514560 00000100:00100000:1.0:1788664311.876613:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788664311.876623:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140514560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664311.876674:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788664311.876736:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140514560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664311.876744:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788664311.876827:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140514560:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788664312.259841:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664312.385742:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140514688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788664312.385880:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664312.385977:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140514688 00000100:00100000:2.0:1788664312.385987:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140514688 00000100:00100000:2.0:1788664312.386057:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788664312.386069:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140514688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788664312.386125:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664312.386181:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140514688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664312.386190:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1788664312.386226:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664312.386275:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140514688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788664312.386901:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140514816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664312.386956:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664312.387009:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140514816 00000100:00100000:2.0:1788664312.387016:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140514816 00000100:00100000:2.0:1788664312.387057:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788664312.387065:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140514816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664312.387095:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664312.387136:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140514816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664312.387143:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1788664312.387161:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664312.387191:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140514816:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788664313.279197:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664314.302172:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664314.466244:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664314.466575:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119467904 00000100:00100000:1.0:1788664314.466590:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119467904 00000100:00100000:1.0:1788664314.466699:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:1.0:1788664314.466714:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:11060:x1875550119467904:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788664314.466953:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:11060:x1875550119467904:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 243us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664314.466962:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00080000:2.0:1788664314.467190:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664314.488656:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664314.488881:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119468032 00000100:00100000:1.0:1788664314.488894:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119468032 00000100:00100000:1.0:1788664314.488992:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:1.0:1788664314.489005:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:11060:x1875550119468032:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788664314.489169:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:11060:x1875550119468032:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 166us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664314.489178:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00080000:2.0:1788664314.489969:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664314.503544:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664314.503666:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119468288 00000100:00100000:0.0:1788664314.503679:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119468288 00000100:00100000:0.0:1788664314.503759:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788664314.503813:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:11060:x1875550119468288:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788664314.504137:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:11060:x1875550119468288:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 365us (608us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788664314.504147:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788664314.814570:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664314.814725:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119468416 00000100:00100000:1.0:1788664314.814739:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119468416 00000100:00100000:1.0:1788664314.814874:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:1.0:1788664314.814885:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:11866:x1875550119468416:12345-192.168.203.52@tcp:101:lsof.0 00010000:00010000:1.0:1788664314.814938:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664314.814970:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e119 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d460 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664314.815060:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e120 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664314.815079:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e120 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664314.815094:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e120 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664314.815164:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788664314.815168:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664314.815219:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e120 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664314.815249:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e119 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d460 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664314.815273:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e120 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d460 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664314.815283:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4350d0b00) 00010000:00010000:1.0:1788664314.815286:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788664314.815290:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b84800, rc 0) 00000100:00100000:1.0:1788664314.815390:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:11866:x1875550119468416:12345-192.168.203.52@tcp:101:lsof.0 Request processed in 506us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664314.815398:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00080000:2.0:1788664314.815499:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788664315.326319:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664315.454198:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664315.454231:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140514944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664315.454349:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664315.454579:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140514944 00000100:00100000:1.0:1788664315.454591:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140514944 00000100:00100000:1.0:1788664315.454808:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788664315.454822:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140514944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788664315.454879:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788664315.454957:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140514944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664315.454965:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788664315.455057:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140514944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664315.966090:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140515072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664315.966183:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664315.968274:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140515072 00000100:00100000:3.0:1788664315.968286:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140515072 00000100:00100000:2.0:1788664315.969083:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140515200:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.969163:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664315.969208:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140515712:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.969236:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664315.969259:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f8a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140516224:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.969284:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664315.969309:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788664315.969331:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140515328:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.969361:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664315.969383:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140515840:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.969405:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664315.969422:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f8a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140516352:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.969445:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664315.969481:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140515200 00000100:00100000:2.0:1788664315.969485:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140515200 00000100:00100000:2.0:1788664315.969535:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788664315.969544:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140515200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.969594:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140515200:12345-0@lo:400:kworker.0 Request processed in 51us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664315.969601:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788664315.969632:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140515712 00000100:00100000:2.0:1788664315.969636:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140515712 00000100:00100000:2.0:1788664315.969663:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788664315.969670:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140515712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.969704:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140515712:12345-0@lo:400:kworker.0 Request processed in 35us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664315.969710:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788664315.969727:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140516224 00000100:00100000:2.0:1788664315.969730:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140516224 00000100:00100000:2.0:1788664315.969759:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788664315.969767:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140516224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.969823:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140516224:12345-0@lo:400:kworker.0 Request processed in 57us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664315.969839:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788664315.969859:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140515456:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.969888:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664315.969908:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140515968:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.969928:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664315.970026:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140516480:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.970052:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664315.970073:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788664315.970080:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140515584:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.970102:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664315.970113:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f8a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140516096:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.970132:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664315.970150:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140516608:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.970170:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664315.970193:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140516096 00000100:00100000:2.0:1788664315.970196:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140516096 00000100:00100000:2.0:1788664315.970219:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140516608 00000100:00100000:2.0:1788664315.970222:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140516608 00000100:00100000:2.0:1788664315.970237:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788664315.970243:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140516096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.970280:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140516096:12345-0@lo:400:kworker.0 Request processed in 37us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664315.970286:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788664315.970297:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788664315.970302:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140516608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.970337:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140516608:12345-0@lo:400:kworker.0 Request processed in 35us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664315.970343:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788664315.970367:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140515456 00000100:00100000:2.0:1788664315.970371:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140515456 00000100:00100000:2.0:1788664315.970393:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788664315.970399:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140515456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.970428:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140515456:12345-0@lo:400:kworker.0 Request processed in 30us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664315.970434:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:2.0:1788664315.970452:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664315.970456:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664315.970487:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f8a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140516096:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.970497:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140516608:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.970515:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140515456:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.970546:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140515328 00000100:00100000:2.0:1788664315.970549:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140515328 00000100:00100000:2.0:1788664315.970567:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140515840 00000100:00100000:2.0:1788664315.970570:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140515840 00000100:00100000:2.0:1788664315.970588:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140516352 00000100:00100000:2.0:1788664315.970591:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140516352 00000100:00100000:2.0:1788664315.970602:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140515968 00000100:00100000:2.0:1788664315.970604:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140515968 00000100:00100000:2.0:1788664315.970615:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140516480 00000100:00100000:2.0:1788664315.970617:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140516480 00000100:00100000:2.0:1788664315.970626:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140515584 00000100:00100000:2.0:1788664315.970628:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140515584 00000100:00100000:2.0:1788664315.970637:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788664315.970650:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140515328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.970685:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140515328:12345-0@lo:400:kworker.0 Request processed in 36us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664315.970692:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788664315.970704:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788664315.970710:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140515840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.970735:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140515840:12345-0@lo:400:kworker.0 Request processed in 25us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664315.970739:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788664315.970750:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788664315.970755:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140516352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.970801:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140516352:12345-0@lo:400:kworker.0 Request processed in 47us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664315.970807:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788664315.970817:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788664315.970822:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140515968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.970850:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140515968:12345-0@lo:400:kworker.0 Request processed in 29us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664315.970855:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788664315.970866:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788664315.970872:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43526f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140516480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.970896:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43526f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140516480:12345-0@lo:400:kworker.0 Request processed in 25us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664315.970901:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788664315.970911:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788664315.970923:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140515584:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788664315.973268:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664315.973278:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788664315.973326:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c43f762300 x1875550140515968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664315.973343:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140515968:0@lo:400:kworker.0 00010000:00080000:1.0:1788664315.973358:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039c8380 x1875550140516480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664315.973366:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140516480:0@lo:400:kworker.0 00000100:00100000:1.0:1788664315.973413:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140515328:0@lo:400:kworker.0 00000100:00100000:1.0:1788664315.973425:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140515840:0@lo:400:kworker.0 00000100:00100000:1.0:1788664315.973435:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f8a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140516352:0@lo:400:kworker.0 00000100:00100000:1.0:1788664315.973445:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140515200:0@lo:400:kworker.0 00000100:00100000:1.0:1788664315.973456:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140515712:0@lo:400:kworker.0 00000100:00100000:1.0:1788664315.973467:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f8a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140516224:0@lo:400:kworker.0 00000100:00100000:2.0:1788664315.973637:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140515584:12345-0@lo:400:kworker.0 Request processed in 2712us (3531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664315.973648:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788664315.975215:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140515584:0@lo:400:kworker.0 00000100:00100000:3.0:1788664315.980512:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788664315.980539:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140515072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664315.980576:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788664315.980672:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140515072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (14491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664315.980680:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788664315.980835:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1788664315.980843:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c303a92d80, transno 4294967311 00000004:00080000:1.0:1788664315.980862:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1788664315.980889:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140515072:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788664315.982762:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:0.0:1788664315.982794:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788664315.982905:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788664315.982916:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788664316.357635:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664316.478161:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140516736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664316.478233:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664316.478370:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140516736 00000100:00100000:0.0:1788664316.478379:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140516736 00000100:00100000:0.0:1788664316.478432:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788664316.478442:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140516736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664316.478465:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788664316.478525:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140516736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664316.478532:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788664316.478938:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140516736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664316.567372:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664316.567476:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664316.567534:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664316.567621:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664316.567647:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664316.567669:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664316.567726:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119468800 00000100:00100000:3.0:1788664316.567735:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119468800 00000100:00100000:3.0:1788664316.567823:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119469312 00000100:00100000:3.0:1788664316.567826:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119469312 00000100:00100000:3.0:1788664316.567847:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119468672 00000100:00100000:3.0:1788664316.567849:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119468672 00000100:00100000:3.0:1788664316.567868:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 342 00000100:00100000:3.0:1788664316.567878:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119468800:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664316.567961:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119468800:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 84us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664316.567969:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 342 00000100:00100000:3.0:1788664316.567988:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 343 00000100:00100000:3.0:1788664316.567995:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2392:x1875550119469312:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664316.568019:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2392:x1875550119469312:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664316.568043:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 343 00000100:00100000:3.0:1788664316.568057:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 344 00000100:00100000:3.0:1788664316.568063:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:2392:x1875550119468672:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664316.568093:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:2392:x1875550119468672:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664316.568099:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 344 00000100:00080000:3.0:1788664316.568267:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664316.568272:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788664316.570870:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119468544 00000100:00100000:1.0:1788664316.570885:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119468544 00000100:00100000:1.0:1788664316.571391:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 392 00000100:00100000:1.0:1788664316.571403:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2392:x1875550119468544:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664316.571724:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2392:x1875550119468544:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 322us (4360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664316.571733:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 392 00000100:00100000:2.0:1788664316.572883:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664316.572920:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119469184 00000100:00100000:2.0:1788664316.572933:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119469184 00000100:00100000:2.0:1788664316.572989:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 345 00000100:00100000:2.0:1788664316.573000:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2392:x1875550119469184:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664316.573060:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2392:x1875550119469184:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 61us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664316.573068:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 345 00000100:00080000:2.0:1788664316.573088:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664316.579933:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119469056 00000100:00100000:3.0:1788664316.579981:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119468928 00000100:00100000:3.0:1788664316.579993:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119468928 00000100:00080000:2.0:1788664316.580172:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664316.580211:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119469056 00000100:00100000:3.0:1788664316.580250:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00080000:1.0:1788664316.580353:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664316.580396:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119468928:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664316.580910:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119468928:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 103us (12824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664316.591154:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:0.0:1788664316.591184:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 143 00000100:00100000:0.0:1788664316.591574:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119469056:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664316.591672:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119469056:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 477us (24136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664316.591680:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 143 00000100:00100000:0.0:1788664316.991163:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664316.991186:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140516864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788664316.991264:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664316.991403:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140516864 00000100:00100000:2.0:1788664316.991422:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140516864 00000100:00100000:2.0:1788664316.991521:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788664316.991537:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140516864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788664316.991591:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788664316.991803:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140516864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 240us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664316.991812:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788664316.995947:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140516864:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788664317.376345:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664317.502142:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664317.502175:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140516992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664317.502272:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664317.502451:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140516992 00000100:00100000:2.0:1788664317.502462:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140516992 00000100:00100000:2.0:1788664317.502539:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788664317.502549:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140516992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788664317.502587:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664317.502650:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140516992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664317.502657:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1788664317.503076:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664317.503098:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140517120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664317.503133:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664317.503186:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140516992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788664317.505134:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140517120 00000100:00100000:2.0:1788664317.505152:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140517120 00000100:00100000:2.0:1788664317.505261:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788664317.505273:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140517120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664317.505313:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664317.505434:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140517120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (2299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664317.505442:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788664317.506166:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140517120:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788664317.507700:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788664318.400883:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788664319.232786:0:14506:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:11:57 (1788664317) 00010000:00010000:2.0:1788664319.422162:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664320.447881:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664320.574287:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140517248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664320.574417:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664320.574819:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140517248 00000100:00100000:3.0:1788664320.574831:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140517248 00000100:00100000:3.0:1788664320.574896:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788664320.574908:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140517248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664320.574980:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788664320.575046:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140517248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664320.575055:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788664320.575528:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140517248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664320.983167:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664320.983259:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119469568 00000100:00100000:3.0:1788664320.983272:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119469568 00000100:00100000:3.0:1788664320.983375:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:3.0:1788664320.983387:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:12133:x1875550119469568:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664320.983414:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664320.983440:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e127 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d467 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.983540:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e12e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.983560:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e12e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.983575:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e12e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788664320.983894:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788664320.985548:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e135 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.985574:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e135 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.985588:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e135 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.985720:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413e13c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.985730:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413e13c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.985737:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413e13c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664320.985748:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788664320.986584:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e12e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.986594:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e12e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.986601:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e12e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.986607:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664320.986611:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e12e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.986619:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e12e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.986633:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c3027e5a00) 00010000:00010000:3.0:1788664320.986636:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664320.986641:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e12e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.986662:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e12e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.986677:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e135 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.986683:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e135 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.986688:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e135 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.986693:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664320.986696:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e135 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.986701:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e135 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.986708:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93c4350d0200) 00010000:00010000:3.0:1788664320.986711:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664320.986713:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e135 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.986719:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e135 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.993038:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e127 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d467 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.993065:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413e13c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d467 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664320.993088:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c4350d6600) 00010000:00010000:3.0:1788664320.993092:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664320.993096:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502b800, rc 0) 00000100:00100000:3.0:1788664320.993171:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:12133:x1875550119469568:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 9785us (10015us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788664320.993181:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:2.0:1788664320.999483:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664321.002742:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119469696 00000100:00100000:3.0:1788664321.002895:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119469696 00000100:00100000:2.0:1788664321.003053:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664321.003139:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 151 00000100:00100000:2.0:1788664321.003151:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:12133:x1875550119469696:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788664321.003275:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:12133:x1875550119469696:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 126us (3811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664321.003302:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 151 00000100:00100000:0.0:1788664321.003636:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119469824 00000100:00100000:0.0:1788664321.003643:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119469824 00000100:00100000:0.0:1788664321.003688:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1788664321.003698:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c412c70850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:2393:x1875550119469824:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664321.003710:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664321.003748:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413e13c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d467 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664321.003800:0:10332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c4350d6600) 00010000:00010000:0.0:1788664321.003805:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664321.003831:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c412c70850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:2393:x1875550119469824:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 136us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664321.003838:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788664321.007640:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664321.007725:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119469952 00000100:00100000:3.0:1788664321.007736:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119469952 00000100:00100000:3.0:1788664321.007833:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:3.0:1788664321.007844:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:12133:x1875550119469952:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788664321.007994:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:12133:x1875550119469952:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 151us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664321.008001:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00080000:0.0:1788664321.008227:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1788664321.026552:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788664321.026562:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788664321.026665:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788664321.026674:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788664321.086171:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664321.086209:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140517376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664321.086331:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664321.086447:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140517760:0@lo:400:kworker.0 00000100:00100000:3.0:1788664321.086495:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664321.086541:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140518272:0@lo:400:kworker.0 00000100:00100000:2.0:1788664321.086568:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140517888:0@lo:400:kworker.0 00000100:00100000:3.0:1788664321.086580:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664321.086621:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140518784:0@lo:400:kworker.0 00000100:00100000:2.0:1788664321.086653:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664321.086672:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140517632:0@lo:400:kworker.0 00000100:00100000:2.0:1788664321.086709:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140518400:0@lo:400:kworker.0 00000100:00100000:3.0:1788664321.086744:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664321.086752:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664321.086813:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140518144:0@lo:400:kworker.0 00000100:00100000:3.0:1788664321.086846:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664321.086872:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140518656:0@lo:400:kworker.0 00000100:00100000:3.0:1788664321.086896:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664321.086917:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788664321.086924:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140517504:0@lo:400:kworker.0 00000100:00100000:3.0:1788664321.086957:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664321.086979:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140518016:0@lo:400:kworker.0 00000100:00100000:3.0:1788664321.087008:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664321.087115:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140518912:0@lo:400:kworker.0 00000100:00100000:2.0:1788664321.087159:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664321.087164:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140517376 00000100:00100000:0.0:1788664321.087179:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140517376 00000100:00100000:0.0:1788664321.087262:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788664321.087277:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140517376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664321.087279:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140518400 00000100:00100000:2.0:1788664321.087289:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140518400 00002000:00000024:0.0:1788664321.087328:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788664321.087392:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140517376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664321.087410:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1788664321.087444:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664321.087448:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140518912 00000100:00080000:0.0:1788664321.087450:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664321.087457:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140518912 00000100:00080000:0.0:1788664321.087509:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664321.087525:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788664321.087538:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140518400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664321.087562:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140518272 00000100:00100000:0.0:1788664321.087568:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140518272 00000100:00100000:0.0:1788664321.087609:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140517888 00000100:00100000:0.0:1788664321.087614:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140517888 00000100:00100000:2.0:1788664321.087620:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140518400:12345-0@lo:400:kworker.0 Request processed in 82us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664321.087633:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788664321.087636:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140517632 00000100:00100000:0.0:1788664321.087641:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140517632 00000100:00100000:2.0:1788664321.087663:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788664321.087666:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140518144 00000100:00100000:0.0:1788664321.087671:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140518144 00000100:00100000:2.0:1788664321.087679:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140518912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664321.087694:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140518656 00000100:00100000:0.0:1788664321.087704:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140518656 00000100:00100000:2.0:1788664321.087727:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140518912:12345-0@lo:400:kworker.0 Request processed in 54us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664321.087735:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788664321.087746:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788664321.087754:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140518272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664321.087828:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140518272:12345-0@lo:400:kworker.0 Request processed in 82us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664321.087834:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788664321.087855:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788664321.087861:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140517888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664321.087906:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140517504 00000100:00100000:0.0:1788664321.087915:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140517888:12345-0@lo:400:kworker.0 Request processed in 52us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664321.087917:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140517504 00000100:00100000:0.0:1788664321.087931:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788664321.087954:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788664321.087961:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140517632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664321.087977:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788664321.087997:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140517632:12345-0@lo:400:kworker.0 Request processed in 30us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664321.087999:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140517504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664321.088023:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788664321.088053:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788664321.088067:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4367f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140518144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664321.088079:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140517504:12345-0@lo:400:kworker.0 Request processed in 88us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664321.088088:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788664321.088129:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4367f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140518144:12345-0@lo:400:kworker.0 Request processed in 66us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664321.088137:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788664321.088157:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788664321.088171:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140518656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664321.088207:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140518656:12345-0@lo:400:kworker.0 Request processed in 43us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664321.088213:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788664321.088225:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664321.088242:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140517760 00000100:00100000:0.0:1788664321.088249:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140517760 00000100:00100000:0.0:1788664321.088294:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140518016 00000100:00100000:0.0:1788664321.088299:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140518016 00000100:00100000:1.0:1788664321.088300:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140517376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664321.088332:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00010000:00080000:1.0:1788664321.088351:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3041d8e00 x1875550140518272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664321.088351:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140517760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664321.088376:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140518272:0@lo:400:kworker.0 00000100:00100000:1.0:1788664321.088407:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140518784 00000100:00100000:1.0:1788664321.088412:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140518784 00000100:00100000:0.0:1788664321.088425:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140517760:12345-0@lo:400:kworker.0 Request processed in 83us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664321.088434:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788664321.088459:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788664321.088476:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788664321.088481:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140518016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664321.088490:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140518784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664321.088532:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140518016:12345-0@lo:400:kworker.0 Request processed in 64us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664321.088541:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788664321.088558:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140518784:12345-0@lo:400:kworker.0 Request processed in 69us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664321.088571:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00080000:0.0:1788664321.088585:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664321.088591:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788664321.088617:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3041d8000 x1875550140518784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664321.088628:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140518784:0@lo:400:kworker.0 00000100:00100000:1.0:1788664321.088650:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140517760:0@lo:400:kworker.0 00000100:00100000:0.0:1788664321.088690:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140517888:0@lo:400:kworker.0 00000100:00100000:0.0:1788664321.088712:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140518400:0@lo:400:kworker.0 00000100:00100000:0.0:1788664321.088728:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140518912:0@lo:400:kworker.0 00000100:00100000:2.0:1788664321.091168:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140518016:0@lo:400:kworker.0 00000100:00100000:2.0:1788664321.091189:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140518528:0@lo:400:kworker.0 00000100:00100000:2.0:1788664321.091640:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664321.092270:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140517632:0@lo:400:kworker.0 00000100:00100000:1.0:1788664321.092402:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140518528 00000100:00100000:1.0:1788664321.092412:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140518528 00000100:00100000:1.0:1788664321.092524:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788664321.092537:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140518528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664321.092617:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140518528:12345-0@lo:400:kworker.0 Request processed in 83us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664321.092626:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788664321.093170:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140518144:0@lo:400:kworker.0 00000100:00100000:2.0:1788664321.093185:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140518656:0@lo:400:kworker.0 00000100:00100000:2.0:1788664321.093224:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140517504:0@lo:400:kworker.0 00000100:00100000:2.0:1788664321.093236:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140518528:0@lo:400:kworker.0 00000100:00080000:0.0:1788664321.093337:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788664321.342586:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788664321.471247:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664321.600379:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30436ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140519040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664321.600507:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664321.602254:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140519040 00000100:00100000:3.0:1788664321.602278:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140519040 00000100:00100000:3.0:1788664321.602378:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788664321.602395:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140519040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788664321.602443:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788664321.602575:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140519040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 185us (2068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664321.602583:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788664321.602697:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30436ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140519040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664321.694564:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664321.694618:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664321.694649:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664321.695001:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119470336 00000100:00100000:3.0:1788664321.695014:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119470336 00000100:00100000:3.0:1788664321.695087:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 352 00000100:00100000:3.0:1788664321.695099:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119470336:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664321.696934:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119470336:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 1824us (2302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664321.696968:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 352 00000100:00100000:0.0:1788664321.699155:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119470080 00000100:00100000:0.0:1788664321.699177:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119470080 00000100:00100000:0.0:1788664321.699261:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 394 00000100:00100000:0.0:1788664321.699274:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2392:x1875550119470080:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664321.700598:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2392:x1875550119470080:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 1313us (6036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664321.700613:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 394 00000100:00100000:2.0:1788664321.702020:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664321.702078:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664321.702113:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119470848 00000100:00100000:2.0:1788664321.702124:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119470848 00000100:00100000:2.0:1788664321.702193:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119470208 00000100:00100000:2.0:1788664321.702197:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119470208 00000100:00100000:2.0:1788664321.702225:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 353 00000100:00100000:2.0:1788664321.702236:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2392:x1875550119470848:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664321.702326:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2392:x1875550119470848:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 92us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664321.702335:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 353 00000100:00100000:2.0:1788664321.702353:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 354 00000100:00100000:2.0:1788664321.702360:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:2392:x1875550119470208:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664321.703021:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119470592 00000100:00100000:1.0:1788664321.703029:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119470592 00000100:00100000:1.0:1788664321.703300:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:1.0:1788664321.703311:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119470592:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664321.703383:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119470592:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 74us (8732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664321.703391:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:2.0:1788664321.703481:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:2392:x1875550119470208:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 1119us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664321.703499:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 354 00000100:00080000:2.0:1788664321.703525:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664321.703531:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664321.704138:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664321.708365:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664321.709112:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119470464 00000100:00100000:0.0:1788664321.709126:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119470464 00000100:00100000:0.0:1788664321.709210:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:0.0:1788664321.709221:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119470464:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664321.709313:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2392:x1875550119470464:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 93us (5176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664321.709321:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:0.0:1788664321.710156:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119470720 00000100:00100000:0.0:1788664321.710167:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119470720 00000100:00100000:0.0:1788664321.710243:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 355 00000100:00100000:0.0:1788664321.710252:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2392:x1875550119470720:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664321.710315:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2392:x1875550119470720:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 63us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664321.710323:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 355 00000100:00080000:2.0:1788664321.712542:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664321.712555:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664322.112117:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664322.112151:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140519168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664322.112267:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664322.112358:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140519168 00000100:00100000:1.0:1788664322.112368:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140519168 00000100:00100000:1.0:1788664322.112428:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788664322.112440:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140519168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664322.112498:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788664322.112559:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140519168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664322.112567:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788664322.112628:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140519168:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788664322.496908:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664322.623474:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664322.623507:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30436ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140519296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664322.623608:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664322.623736:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140519296 00000100:00100000:2.0:1788664322.623746:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140519296 00000100:00100000:2.0:1788664322.623826:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788664322.623836:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140519296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664322.623878:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664322.623930:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140519296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664322.623938:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788664322.623996:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30436ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140519296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664322.626603:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140519424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664322.626717:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664322.626817:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140519424 00000100:00100000:3.0:1788664322.626826:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140519424 00000100:00100000:3.0:1788664322.626884:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788664322.626894:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30436a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140519424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788664322.626927:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664322.626978:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30436a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140519424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664322.626986:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788664322.627215:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140519424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788664323.418595:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664323.419209:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119470976 00000100:00100000:1.0:1788664323.419225:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119470976 00000100:00100000:1.0:1788664323.419364:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 153 00000100:00100000:1.0:1788664323.419377:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:12176:x1875550119470976:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788664323.419406:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664323.419446:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e14a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d46e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419545:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e151 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419571:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e151 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419588:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e151 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419608:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e158 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419616:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e158 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419623:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e158 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419684:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e151 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419692:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e151 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419699:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e151 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419705:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85c00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664323.419710:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e151 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419718:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e151 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419732:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4350d0b00) 00010000:00010000:1.0:1788664323.419739:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664323.419746:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e151 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419753:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e151 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419764:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e158 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419796:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e158 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419803:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e158 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419808:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664323.419810:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e158 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419815:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e158 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419822:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93c3027e5600) 00010000:00010000:1.0:1788664323.419825:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664323.419828:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e158 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419834:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e158 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419870:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e14a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d46e expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419890:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4350d0b00) 00010000:00010000:1.0:1788664323.419893:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664323.419897:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e14a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d46e expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.419905:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b84600, rc 0) 00000100:00100000:1.0:1788664323.419986:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:12176:x1875550119470976:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 612us (1407us total) trans 0 rc 301/301 00000100:00100000:1.0:1788664323.419994:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 153 00000100:00080000:2.0:1788664323.420488:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664323.436900:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664323.437206:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119471232 00000100:00100000:1.0:1788664323.437220:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119471232 00000100:00100000:1.0:1788664323.437300:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00100000:1.0:1788664323.437312:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+14:12176:x1875550119471232:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:1.0:1788664323.437391:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664323.437439:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ef000/0xcd11f61c1413da9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d292 expref: 14 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.437470:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4350d0b00) 00010000:00010000:1.0:1788664323.437476:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664323.437558:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e15f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.437575:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e120 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d460 expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.437585:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e15f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.437641:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e120 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d460 expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.437657:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e120 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d460 expref: 5 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664323.437675:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140519552:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664323.437823:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6480 going to sleep for 11 seconds 00000100:00100000:1.0:1788664323.442808:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140519552:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664323.442828:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:1.0:1788664323.442849:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e15f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664323.442928:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119471360 00000100:00100000:3.0:1788664323.442937:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119471360 00010000:00010000:3.0:1788664323.442999:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e120 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d460 expref: 6 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664323.443047:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:3.0:1788664323.443057:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2391:x1875550119471360:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664323.443078:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664323.443086:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e120 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d460 expref: 6 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664323.443100:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e120 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d460 expref: 6 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664323.443156:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e120 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d460 expref: 6 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664323.443174:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4350d0b00) 00010000:00010000:3.0:1788664323.443180:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e15f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664323.443191:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e15f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664323.443200:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e15f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664323.443237:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664323.443303:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119471360:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 247us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664323.443311:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00010000:00010000:1.0:1788664323.443517:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e15f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.443525:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e15f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.443565:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e166 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.443577:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e166 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.443585:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e166 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788664323.443704:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788664323.446343:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e16d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.446381:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e16d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.446397:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e16d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788664323.446418:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004056086c reply state 000000000b9cc753 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e16d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.446767:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e16d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.446838:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:1.0:1788664323.446841:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788664323.446847:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788664323.446855:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788664323.446865:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e15f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.446872:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e15f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.446879:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e15f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.446885:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85c00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664323.446890:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e15f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.446897:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e15f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.446920:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c4350d0b00) 00010000:00010000:1.0:1788664323.446923:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664323.446927:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e15f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.446934:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e15f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788664323.446956:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004056086c reply state 000000000b9cc753 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e166 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.446964:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e166 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.446969:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93c3027e5600) 00010000:00010000:1.0:1788664323.447508:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788664323.447513:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788664323.447810:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:12176:x1875550119471232:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 10452us (10878us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1788664323.447823:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 154 00010000:00010000:0.0:1788664323.518489:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664323.579515:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664323.579569:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119471488 00000100:00100000:0.0:1788664323.579581:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119471488 00000100:00100000:0.0:1788664323.579646:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 155 00000100:00100000:0.0:1788664323.579658:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+15:12184:x1875550119471488:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:0.0:1788664323.579691:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664323.579734:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e174 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d475 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.579836:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413e17b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.579853:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413e17b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.579866:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413e17b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664323.579928:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788664323.579932:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788664323.579958:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413e17b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.579985:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e174 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d475 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.580015:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413e17b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d475 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.580025:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c303887300) 00010000:00010000:0.0:1788664323.580028:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664323.580032:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956000, rc 0) 00000100:00100000:0.0:1788664323.580114:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+16:12184:x1875550119471488:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 458us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664323.580122:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 155 00000100:00100000:2.0:1788664323.673423:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664323.673731:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119471616 00000100:00100000:1.0:1788664323.673744:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119471616 00000100:00100000:0.0:1788664323.673909:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 156 00000100:00100000:0.0:1788664323.673925:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+16:12190:x1875550119471616:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788664323.673955:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664323.673984:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e182 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d47c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674082:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e189 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674101:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e189 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674115:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e189 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674127:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e190 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674178:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e190 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674187:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e190 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674295:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413e197 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674305:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413e197 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674312:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413e197 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664323.674361:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788664323.674365:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788664323.674402:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413e197 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674414:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e189 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674421:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e189 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674428:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e189 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674434:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664323.674439:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e189 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674466:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e189 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674481:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c303887300) 00010000:00010000:0.0:1788664323.674484:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664323.674489:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e189 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674496:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e189 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674513:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e190 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674519:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e190 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674525:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e190 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674530:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957a00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664323.674533:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e190 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674539:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e190 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674546:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93c3027e5600) 00010000:00010000:0.0:1788664323.674549:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664323.674552:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e190 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674569:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e190 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674603:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e182 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d47c expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674619:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413e197 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d47c expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.674627:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:0.0:1788664323.674629:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788664323.674631:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956200, rc 0) 00000100:00100000:0.0:1788664323.674727:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:12190:x1875550119471616:12345-192.168.203.52@tcp:101:bash.0 Request processed in 806us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664323.674736:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 156 00000100:00100000:0.0:1788664323.684192:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664323.684291:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119471872 00000100:00100000:1.0:1788664323.684305:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119471872 00000100:00100000:1.0:1788664323.684373:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 157 00000100:00100000:1.0:1788664323.684399:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40532f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:12190:x1875550119471872:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788664323.684429:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664323.684468:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e19e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d483 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.684643:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e1a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.684664:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e1a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.684679:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e1a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.684698:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e1ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.684706:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e1ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.684714:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e1ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788664323.685576:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788664323.685850:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e1b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.685867:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.685879:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.685922:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e1a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.685931:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e1a5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.685938:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e1a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.686076:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664323.686082:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e1a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.686093:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e1a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.686108:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:2.0:1788664323.686112:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664323.686118:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e1a5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.686125:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e1a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664323.686152:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076baac01 reply state 00000000d9a8fe42 transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e1ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.686165:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e1ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.686172:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c3027e5400) 00010000:00010000:2.0:1788664323.686174:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788664323.686177:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788664323.686220:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e19e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d483 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.686237:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e1b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d483 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.686244:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6b00) 00010000:00010000:2.0:1788664323.686246:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664323.686248:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0ce00, rc 0) 00000100:00100000:2.0:1788664323.686357:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40532f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:12190:x1875550119471872:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1961us (2182us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788664323.686366:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 157 00000100:00100000:2.0:1788664323.705406:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664323.705741:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119472000 00000100:00100000:0.0:1788664323.705754:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119472000 00000100:00100000:1.0:1788664323.706224:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:1.0:1788664323.706248:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119472000:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788664323.706280:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664323.706308:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e1c1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d48a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664323.706340:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664323.706366:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=418s v=(0 0) 00010000:00010000:1.0:1788664323.706371:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664323.706382:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e1c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d48a expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.706423:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e1c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d48a expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.706440:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85000, rc 0) 00000100:00100000:1.0:1788664323.706538:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2390:x1875550119472000:12345-192.168.203.52@tcp:101:bash.0 Request processed in 293us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664323.706547:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00080000:2.0:1788664323.710798:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664323.716171:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664323.716360:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119472128 00000100:00100000:1.0:1788664323.716374:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119472128 00000100:00100000:1.0:1788664323.716457:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:1.0:1788664323.716470:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4012e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:12190:x1875550119472128:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788664323.716495:0:9895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664323.716517:0:9895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d491 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.716560:0:9895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e1c1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d48a expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.716570:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664323.716575:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664323.716582:0:9895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 7 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.716627:0:9895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e1c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d48a expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.716665:0:9895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e1c1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d48a expref: 7 pid: 8426 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664323.716683:0:9895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9895:1875550140519680:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664323.716864:0:9895:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788664323.720898:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664323.721039:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119472256 00000100:00100000:0.0:1788664323.721052:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119472256 00010000:00010000:0.0:1788664323.721107:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e1c1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d48a expref: 8 pid: 8426 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664323.721163:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:0.0:1788664323.721175:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2391:x1875550119472256:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664323.721197:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664323.721260:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e1c1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d48a expref: 8 pid: 8426 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.721275:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e1c1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d48a expref: 8 pid: 8426 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.721307:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664323.721313:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664323.721323:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 8 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.721335:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 8 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.721381:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 8 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664323.721399:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041cd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6496:1875550140519808:192.168.203.52@tcp:105: 00000100:00100000:0.0:1788664323.721521:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086180 going to sleep for 11 seconds 00010000:00010000:1.0:1788664323.722924:0:9895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf4a5f6e/0xcd11f61c1413e1c1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d48a expref: 8 pid: 8426 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664323.722950:0:9895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9895:1875550140519680:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664323.722985:0:9895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 7 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664323.722999:0:9895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85200, rc 0) 00000100:00100000:1.0:1788664323.723078:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4012e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:12190:x1875550119472128:12345-192.168.203.52@tcp:101:bash.0 Request processed in 6610us (6920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664323.723089:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:3.0:1788664323.730052:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664323.730211:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119472512 00000100:00100000:1.0:1788664323.730224:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119472512 00000100:00100000:1.0:1788664323.730319:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:1.0:1788664323.730332:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:12190:x1875550119472512:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:1.0:1788664323.730746:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:12190:x1875550119472512:12345-192.168.203.52@tcp:35:bash.0 Request processed in 415us (706us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788664323.730755:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:0.0:1788664323.731754:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041cd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6496:1875550140519808:192.168.203.52@tcp:105: 00010000:00010000:0.0:1788664323.731841:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664323.731906:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119472256:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 10733us (11024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664323.731916:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:3.0:1788664323.817218:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664323.817503:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119472768 00000100:00100000:0.0:1788664323.817517:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119472768 00000100:00100000:0.0:1788664323.817616:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 158 00000100:00100000:0.0:1788664323.817629:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30436b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:12200:x1875550119472768:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664323.817666:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664323.817901:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e1cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d498 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664323.818045:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788664323.818177:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e1cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d498 expref: 23 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.818195:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c303887300) 00010000:00010000:0.0:1788664323.818199:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788664323.818205:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e1cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d498 expref: 23 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.818223:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956600, rc 0) 00000100:00100000:0.0:1788664323.818313:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30436b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:12200:x1875550119472768:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 687us (1111us total) trans 4294967422 rc 301/301 00000100:00100000:0.0:1788664323.818322:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 158 00000100:00100000:0.0:1788664323.822520:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664323.822643:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119473024 00000100:00100000:1.0:1788664323.822658:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119473024 00000100:00100000:1.0:1788664323.822745:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:1.0:1788664323.822759:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:12200:x1875550119473024:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788664323.823108:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+23:12200:x1875550119473024:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 352us (603us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1788664323.823117:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:3.0:1788664323.919142:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664323.921852:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119473152 00000100:00100000:0.0:1788664323.921877:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119473152 00000100:00100000:0.0:1788664323.922227:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00100000:0.0:1788664323.922243:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30436b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+23:12206:x1875550119473152:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664323.922289:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664323.922554:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e1dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d49f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.922682:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e1e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.922869:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.922890:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664323.922963:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788664323.922969:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788664323.922993:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.923024:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e1dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d49f expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.923047:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d49f expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.923641:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:0.0:1788664323.923650:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664323.923655:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956c00, rc 0) 00000100:00100000:0.0:1788664323.923935:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30436b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:12206:x1875550119473152:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1692us (4805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664323.923955:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00100000:3.0:1788664323.932755:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664323.937066:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119473408 00000100:00100000:2.0:1788664323.937089:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119473408 00000100:00100000:2.0:1788664323.937207:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 160 00000100:00100000:2.0:1788664323.937221:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:12206:x1875550119473408:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664323.937272:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664323.937312:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e1eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d4a6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.937473:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e1f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.937490:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e1f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.937505:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e1f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664323.937519:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788664323.937674:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e1eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4a6 expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.937695:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e1f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4a6 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.937705:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6b00) 00010000:00010000:2.0:1788664323.937708:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664323.937713:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c400, rc 0) 00000100:00100000:2.0:1788664323.937847:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+26:12206:x1875550119473408:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 629us (5107us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1788664323.937855:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 160 00000100:00100000:2.0:1788664323.949485:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664323.949944:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119473664 00000100:00100000:0.0:1788664323.949958:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119473664 00000100:00100000:0.0:1788664323.950115:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 161 00000100:00100000:0.0:1788664323.950127:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+26:12206:x1875550119473664:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664323.950160:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664323.950189:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e200 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d4ad expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.950338:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e207 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.950356:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e207 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.950369:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e207 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664323.950383:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788664323.950541:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e200 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4ad expref: 29 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.950564:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e207 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4ad expref: 28 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664323.950574:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6b00) 00010000:00010000:0.0:1788664323.950577:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788664323.950581:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957000, rc 0) 00000100:00100000:0.0:1788664323.950716:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+28:12206:x1875550119473664:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 591us (1245us total) trans 4294967425 rc 0/0 00000100:00100000:0.0:1788664323.950724:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 161 00000100:00100000:1.0:1788664323.960047:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664323.963109:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119473792 00000100:00100000:2.0:1788664323.963132:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119473792 00000100:00100000:2.0:1788664323.963269:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1788664323.963282:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+28:2392:x1875550119473792:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664323.963306:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664323.963340:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e1f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4a6 expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.963368:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6b00) 00010000:00010000:2.0:1788664323.963375:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664323.963475:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+27:2392:x1875550119473792:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 195us (3443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664323.963483:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1788664323.972410:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664323.972569:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119473920 00000100:00100000:3.0:1788664323.972583:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119473920 00000100:00100000:3.0:1788664323.972672:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:3.0:1788664323.972685:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2392:x1875550119473920:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:3.0:1788664323.972766:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023ae1041/0xcd11f61c1413e215 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664323.972840:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 6 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664323.972849:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788664323.972854:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664323.972860:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023ae1041/0xcd11f61c1413e215 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664323.972907:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 6 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664323.972925:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 6 pid: 9895 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664323.972943:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30436aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1875550140519936:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664323.977646:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c419920840 going to sleep for 11 seconds 00000100:00100000:1.0:1788664323.981650:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30436aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1875550140519936:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664323.981714:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000023ae1041/0xcd11f61c1413e215 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664323.992381:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664323.993158:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119474048 00000100:00100000:2.0:1788664323.993174:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119474048 00002000:00100000:2.0:1788664323.993250:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff93c3039d5f80 x1875550119474048/t0(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:629/0 lens 504/0 e 0 to 0 dl 1788664334 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664323.993261:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c3039d5f80 with x1875550119474048 ext(0->12) 00010000:00010000:2.0:1788664323.993273:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 7 pid: 9895 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.993295:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 7 pid: 9895 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664323.993304:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c3039d5f80 00000100:00100000:2.0:1788664323.993350:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:2.0:1788664323.993362:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2390:x1875550119474048:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:2.0:1788664323.996876:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2390:x1875550119474048:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 3499us (4494us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788664323.996897:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00002000:00100000:2.0:1788664323.996916:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff93c3039d5f80 x1875550119474048/t4294967306(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:629/0 lens 504/448 e 0 to 0 dl 1788664334 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664323.996930:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c3039d5f80 with x1875550119474048 ext(0->12) 00010000:00010000:2.0:1788664323.996944:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 9 pid: 9895 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664323.996969:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 9 pid: 9895 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664323.996978:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c3039d5f80 00000100:00100000:2.0:1788664324.004508:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664324.004819:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119474176 00000100:00100000:3.0:1788664324.004836:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119474176 00010000:00010000:3.0:1788664324.004902:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 9 pid: 9895 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664324.004956:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:3.0:1788664324.004968:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2390:x1875550119474176:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664324.004991:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788664324.006303:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788664324.006333:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788664323 00002000:00010000:3.0:1788664324.006336:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788664323 00002000:00010000:3.0:1788664324.006338:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788664323 00002000:00010000:3.0:1788664324.006341:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788664324.006356:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 9 pid: 9895 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.006380:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 9 pid: 9895 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.006414:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bdfcfaa/0xcd11f61c1413e1c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d491 expref: 9 pid: 9895 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.006435:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664324.006440:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664324.006456:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023ae1041/0xcd11f61c1413e215 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.006468:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023ae1041/0xcd11f61c1413e215 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.006512:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664324.006636:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2390:x1875550119474176:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 1668us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664324.006647:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00010000:00010000:1.0:1788664324.008578:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000023ae1041/0xcd11f61c1413e215 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.008608:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023ae1041/0xcd11f61c1413e215 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.008654:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023ae1041/0xcd11f61c1413e215 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.008664:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023ae1041/0xcd11f61c1413e215 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.008675:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023ae1041/0xcd11f61c1413e215 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.008719:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b000 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664324.008725:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023ae1041/0xcd11f61c1413e215 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.008736:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023ae1041/0xcd11f61c1413e215 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.008762:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023ae1041/0xcd11f61c1413e215 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.008819:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023ae1041/0xcd11f61c1413e215 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664324.008964:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2392:x1875550119473920:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 36275us (36564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664324.008977:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:1.0:1788664324.012886:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664324.013005:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119474432 00000100:00100000:2.0:1788664324.013028:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119474432 00000100:00100000:2.0:1788664324.013109:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:2.0:1788664324.013123:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c406b60450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+27:12206:x1875550119474432:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:2.0:1788664324.013224:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e207 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4ad expref: 27 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664324.013505:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788664324.013543:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1788664324.013976:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:2.0:1788664324.014025:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e21c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664324.014071:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e1b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d483 expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664324.014082:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e21c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664324.014153:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e1b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d483 expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664324.014170:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e1b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d483 expref: 31 pid: 6511 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664324.014188:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304366680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6514:1875550140520064:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664324.014306:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3034066c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664324.017673:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664324.017829:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119474560 00000100:00100000:0.0:1788664324.017844:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119474560 00010000:00010000:0.0:1788664324.017902:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e1b3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d483 expref: 32 pid: 6511 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664324.017948:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:0.0:1788664324.017960:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+32:2391:x1875550119474560:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664324.017979:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664324.017987:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e1b3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d483 expref: 32 pid: 6511 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.018002:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e1b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d483 expref: 32 pid: 6511 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.018030:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6b00) 00010000:00010000:0.0:1788664324.018036:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e21c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.018047:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e21c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.018055:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e21c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.018079:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664324.018149:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+32:2391:x1875550119474560:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 192us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664324.018158:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00010000:00010000:2.0:1788664324.020161:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e1b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d483 expref: 31 pid: 6511 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664324.020192:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304366680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6514:1875550140520064:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788664324.020228:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e21c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664324.020239:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e21c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664324.020246:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e21c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664324.020542:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:2.0:1788664324.020722:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788664324.020887:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304366680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875550140520192:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788664324.020974:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664324.021026:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3034060c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664324.021163:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140520192 00000100:00100000:1.0:1788664324.021172:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140520192 00000100:00100000:1.0:1788664324.021252:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788664324.021265:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1875550140520192:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788664324.021401:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1875550140520192:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 138us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664324.021409:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788664324.021528:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304366680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875550140520192:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788664324.021679:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:3.0:1788664324.021742:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30436b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875550140520320:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788664324.021803:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664324.021824:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411902a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664324.021882:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140520320 00000100:00100000:1.0:1788664324.021887:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140520320 00000100:00100000:1.0:1788664324.021921:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788664324.021929:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1875550140520320:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1788664324.022202:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664324.022689:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6514:x1875550140520320:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 751us (875us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788664324.022705:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788664324.024089:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30436b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875550140520320:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788664324.024199:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1788664324.024264:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e21c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.024276:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e21c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.024285:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e21c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.024292:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664324.024298:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e21c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.024307:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e21c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.024326:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6b00) 00010000:00010000:3.0:1788664324.024330:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788664324.024335:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e21c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.024342:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e21c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788664324.024489:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788664324.024568:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788664324.024612:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 419161840203ns, next at 420161837673ns, rc = 0 00000001:00080000:3.0:1788664324.024620:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:3.0:1788664324.024648:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6b00) 00010000:00010000:3.0:1788664324.024651:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788664324.024660:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e207 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4ad expref: 35 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664324.024842:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c406b60450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+34:12206:x1875550119474432:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 11722us (11970us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788664324.024854:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000020:00080000:3.0:1788664324.024861:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788664324.040938:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664324.041070:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119474688 00000100:00100000:0.0:1788664324.041105:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119474688 00000100:00100000:0.0:1788664324.041188:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00100000:0.0:1788664324.041199:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+34:12206:x1875550119474688:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664324.041232:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664324.041266:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e223 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d4b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.041347:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e223 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4b4 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.041364:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e223 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4b4 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.041386:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:0.0:1788664324.041390:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664324.041394:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957400, rc 0) 00000100:00100000:0.0:1788664324.041489:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+35:12206:x1875550119474688:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 291us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664324.041497:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00100000:0.0:1788664324.053111:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664324.053227:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119474944 00000100:00100000:1.0:1788664324.053240:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119474944 00000100:00100000:1.0:1788664324.053325:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1788664324.053337:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+35:12206:x1875550119474944:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788664324.053699:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+36:12206:x1875550119474944:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 362us (602us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788664324.053708:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1788664324.155924:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664324.156028:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119475200 00000100:00100000:3.0:1788664324.156043:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119475200 00000100:00100000:3.0:1788664324.156120:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:3.0:1788664324.156132:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+36:12216:x1875550119475200:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664324.156167:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664324.156193:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e22a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d4bb expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664324.156355:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788664324.156498:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e22a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4bb expref: 38 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.156516:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c303887300) 00010000:00010000:3.0:1788664324.156520:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664324.156527:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e22a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4bb expref: 38 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.156572:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a600, rc 0) 00000100:00100000:3.0:1788664324.156663:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+37:12216:x1875550119475200:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 533us (754us total) trans 4294967436 rc 301/301 00000100:00100000:3.0:1788664324.156671:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:2.0:1788664324.162271:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664324.162396:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119475328 00000100:00100000:0.0:1788664324.162410:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119475328 00000100:00100000:0.0:1788664324.162501:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:0.0:1788664324.162514:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+37:12216:x1875550119475328:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:0.0:1788664324.162633:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e238 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.162659:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e238 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.162695:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e238 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.162710:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e23f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.162717:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e23f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.162722:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e23f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.162863:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e246 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.162872:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e246 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.162880:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e246 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664324.162952:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e246 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.162967:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e238 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.162974:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e238 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.162981:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e238 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.162998:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664324.163003:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e238 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163012:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e238 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163026:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:0.0:1788664324.163029:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664324.163034:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e238 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163040:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e238 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163057:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e23f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163062:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e23f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163067:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e23f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163072:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664324.163075:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e23f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163081:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e23f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163101:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c3027e5400) 00010000:00010000:0.0:1788664324.163103:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664324.163107:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e23f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163113:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e23f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163124:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e246 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163131:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e246 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163136:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e246 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163141:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664324.163144:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e246 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163151:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e246 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163158:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:0.0:1788664324.163160:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664324.163163:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e246 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.163169:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e246 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664324.163457:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+37:12216:x1875550119475328:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 774us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664324.163467:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:0.0:1788664324.169603:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664324.169692:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119475584 00000100:00100000:1.0:1788664324.169705:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119475584 00000100:00100000:1.0:1788664324.169811:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:1.0:1788664324.169823:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+37:12216:x1875550119475584:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788664324.170130:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+38:12216:x1875550119475584:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 309us (538us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788664324.170138:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:2.0:1788664324.221588:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664324.221739:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119475840 00000100:00100000:0.0:1788664324.221752:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119475840 00000100:00100000:0.0:1788664324.221885:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:0.0:1788664324.221897:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+38:12219:x1875550119475840:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664324.221934:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664324.221964:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e24d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d4c2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222063:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e254 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222084:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e254 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222098:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e254 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222111:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e25b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222119:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e25b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222126:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e25b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222310:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e262 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222320:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e262 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222327:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e262 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664324.222338:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788664324.222442:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e254 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222461:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e254 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222469:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e254 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222475:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664324.222482:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e254 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222491:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e254 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222506:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:0.0:1788664324.222510:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664324.222516:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e254 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222535:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e254 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222553:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e25b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222560:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e25b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222566:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e25b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222572:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664324.222575:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e25b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222582:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e25b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222590:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c3027e5400) 00010000:00010000:0.0:1788664324.222593:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664324.222596:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e25b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222603:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e25b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222647:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e24d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4c2 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222661:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e262 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4c2 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.222675:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:0.0:1788664324.222678:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664324.222681:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956600, rc 0) 00000100:00100000:0.0:1788664324.222836:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+40:12219:x1875550119475840:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 877us (1201us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788664324.222845:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:2.0:1788664324.226255:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664324.226333:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119475968 00000100:00100000:1.0:1788664324.226347:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119475968 00000100:00100000:1.0:1788664324.226426:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00100000:1.0:1788664324.226438:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+40:12219:x1875550119475968:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1788664324.226561:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e270 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.226583:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e270 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.226597:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e270 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.226641:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e270 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.226649:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e270 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.226657:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e270 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.226664:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664324.226681:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e270 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.226691:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e270 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.226705:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:1.0:1788664324.226709:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788664324.226715:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e270 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.226723:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e270 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664324.226884:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+40:12219:x1875550119475968:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 447us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664324.227200:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00100000:1.0:1788664324.230586:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664324.230706:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119476224 00000100:00100000:0.0:1788664324.230718:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119476224 00000100:00100000:0.0:1788664324.230825:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:0.0:1788664324.230837:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+40:12219:x1875550119476224:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788664324.231138:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+41:12219:x1875550119476224:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 302us (567us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788664324.231147:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00010000:00010000:3.0:1788664324.541974:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664324.622642:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664324.622821:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119476480 00000100:00100000:0.0:1788664324.622833:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119476480 00000100:00100000:0.0:1788664324.622912:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:0.0:1788664324.622924:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+41:12250:x1875550119476480:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:0.0:1788664324.622958:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664324.622988:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e277 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d4c9 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.623136:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e27e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.623154:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e27e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.623189:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e27e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664324.623204:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788664324.623340:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e277 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4c9 expref: 44 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.623364:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e27e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4c9 expref: 43 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.623375:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:0.0:1788664324.623379:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664324.623383:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956400, rc 0) 00000100:00100000:0.0:1788664324.623476:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+43:12250:x1875550119476480:12345-192.168.203.52@tcp:101:cat.0 Request processed in 555us (848us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1788664324.623485:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:2.0:1788664324.630982:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664324.631089:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664324.631205:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119476864 00000100:00100000:1.0:1788664324.631218:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119476864 00000100:00100000:1.0:1788664324.631395:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1788664324.631409:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304366a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+43:2393:x1875550119476864:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664324.631434:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664324.631478:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e27e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4c9 expref: 43 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.631503:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:1.0:1788664324.631519:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664324.631559:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119476736 00000100:00100000:0.0:1788664324.631564:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119476736 00000100:00100000:1.0:1788664324.631598:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304366a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+43:2393:x1875550119476864:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 192us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664324.631601:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:1.0:1788664324.631607:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1788664324.631609:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+43:12250:x1875550119476736:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:0.0:1788664324.632705:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+43:12250:x1875550119476736:12345-192.168.203.52@tcp:35:cat.0 Request processed in 1088us (1730us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788664324.632723:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:2.0:1788664324.705551:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664324.705658:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119477120 00000100:00100000:3.0:1788664324.705672:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119477120 00000100:00100000:3.0:1788664324.705827:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:3.0:1788664324.705841:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+43:12256:x1875550119477120:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:3.0:1788664324.705882:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664324.705887:0:9169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788664324.705931:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e1e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d49f expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.705957:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:3.0:1788664324.705965:0:9169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664324.705986:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e28c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d4d0 expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.706172:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.706187:0:9169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e262 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4c2 expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.706221:0:9169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.706269:0:9169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e262 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4c2 expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.706287:0:9169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e262 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4c2 expref: 43 pid: 6511 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664324.706305:0:9169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304368e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9169:1875550140520448:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664324.706431:0:9169:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411902240 going to sleep for 11 seconds 00000100:00100000:1.0:1788664324.709834:0:9169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304368e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9169:1875550140520448:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664324.709876:0:9169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664324.711172:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664324.711267:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119477248 00000100:00100000:3.0:1788664324.711290:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119477248 00010000:00010000:3.0:1788664324.711344:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e262 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4c2 expref: 44 pid: 6511 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664324.711395:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:3.0:1788664324.711408:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c412c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+44:2391:x1875550119477248:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664324.711431:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664324.711449:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e262 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4c2 expref: 44 pid: 6511 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.711464:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e262 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4c2 expref: 44 pid: 6511 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.711492:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e262 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4c2 expref: 44 pid: 6511 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.711534:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:3.0:1788664324.711541:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.711553:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.711562:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664324.711600:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664324.711697:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c412c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+43:2391:x1875550119477248:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 286us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664324.711705:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00010000:00010000:1.0:1788664324.712368:0:9169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.712381:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664324.712420:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788664324.712613:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e28c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d0 expref: 44 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.712635:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d0 expref: 43 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.712645:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:1.0:1788664324.712647:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788664324.712650:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a600, rc 0) 00000100:00100000:1.0:1788664324.712723:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+43:12256:x1875550119477120:12345-192.168.203.52@tcp:101:dd.0 Request processed in 6885us (7186us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788664324.712732:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:2.0:1788664324.716865:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664324.717228:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119477376 00000100:00100000:1.0:1788664324.717243:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119477376 00000100:00100000:1.0:1788664324.717330:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:1.0:1788664324.717343:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+43:12256:x1875550119477376:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:1.0:1788664324.717378:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664324.717405:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e2a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d4d7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.717459:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e2a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.717477:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.717514:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.717661:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e2a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d7 expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.717682:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e2a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d7 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.717706:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:1.0:1788664324.717709:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788664324.717714:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85000, rc 0) 00000100:00100000:1.0:1788664324.717844:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+44:12256:x1875550119477376:12345-192.168.203.52@tcp:101:dd.0 Request processed in 503us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664324.717852:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:3.0:1788664324.723473:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664324.724764:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119477632 00000100:00100000:0.0:1788664324.724803:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119477632 00000100:00100000:0.0:1788664324.724879:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 170 00000100:00100000:0.0:1788664324.724891:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+44:12256:x1875550119477632:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:0.0:1788664324.725639:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e2af lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.725664:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e2af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.725680:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e2af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788664324.726570:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788664324.726627:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059e6e2b7 reply state 000000000577a842 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e2af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.726647:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e2af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664324.726656:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:0.0:1788664324.726660:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788664324.726664:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788664324.726984:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+47:12256:x1875550119477632:12345-192.168.203.52@tcp:36:dd.0 Request processed in 2089us (3520us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788664324.726995:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 170 00000020:00080000:0.0:1788664324.727113:0:9524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788664324.986920:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664324.988814:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119477760 00000100:00100000:1.0:1788664324.988833:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119477760 00000100:00100000:1.0:1788664324.988934:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 171 00000100:00100000:1.0:1788664324.988947:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+47:12270:x1875550119477760:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:1.0:1788664324.988982:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664324.989388:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e2b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d4de expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.989501:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e2bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.989523:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e2bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.990464:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e2bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.990488:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e2c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.990499:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.990507:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.990880:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e2cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.990898:0:9169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d0 expref: 48 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.990908:0:9169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e2cb lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.990967:0:9169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d0 expref: 48 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664324.990989:0:9169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d0 expref: 48 pid: 9169 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664324.991377:0:9169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eabb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9169:1875550140520576:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664324.992321:0:9169:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664325.010242:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664325.010343:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119478016 00000100:00100000:3.0:1788664325.010356:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119478016 00000100:00100000:3.0:1788664325.010459:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:3.0:1788664325.010472:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+49:6161:x1875550119478016:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788664325.010957:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+50:6161:x1875550119478016:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 486us (726us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1788664325.010967:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1788664325.011403:0:9169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eabb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9169:1875550140520576:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664325.011454:0:9169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e2cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788664325.011619:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664325.014946:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664325.018915:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119478144 00000100:00100000:1.0:1788664325.018937:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119478144 00010000:00010000:1.0:1788664325.019007:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d0 expref: 50 pid: 9169 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664325.019118:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:1.0:1788664325.019130:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30436a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+50:2391:x1875550119478144:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664325.019153:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664325.019161:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d0 expref: 50 pid: 9169 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664325.019178:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d0 expref: 50 pid: 9169 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664325.019207:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e293 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d0 expref: 50 pid: 9169 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664325.019230:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:1.0:1788664325.019237:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e2cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664325.019249:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664325.019257:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e2cb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664325.019321:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664325.019412:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30436a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+49:2391:x1875550119478144:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 284us (4480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664325.019420:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00010000:00010000:3.0:1788664325.021183:0:9169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021204:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664325.021323:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788664325.021329:0:9169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788664325.021367:0:9169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021385:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021397:0:9169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e2bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021404:0:9169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e2bd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021412:0:9169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e2bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021418:0:9169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664325.021423:0:9169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e2bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021431:0:9169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e2bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021456:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:3.0:1788664325.021459:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664325.021464:0:9169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e2bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021471:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e2bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021501:0:9169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021508:0:9169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e2c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021515:0:9169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021521:0:9169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664325.021533:0:9169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021539:0:9169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e2c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021548:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c3027e5400) 00010000:00010000:3.0:1788664325.021551:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664325.021554:0:9169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e2c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021560:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e2c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021611:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e2b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4de expref: 49 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.021630:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e2cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4de expref: 48 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.024644:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:3.0:1788664325.024649:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664325.024655:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b84800, rc 0) 00000100:00100000:3.0:1788664325.024763:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+48:12270:x1875550119477760:12345-192.168.203.52@tcp:101:stat.0 Request processed in 35811us (37852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664325.024792:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 171 00000100:00100000:3.0:1788664325.175426:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664325.175554:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119478400 00000100:00100000:2.0:1788664325.175569:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119478400 00000100:00100000:2.0:1788664325.175659:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 172 00000100:00100000:2.0:1788664325.175673:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+48:12276:x1875550119478400:12345-192.168.203.52@tcp:36:truncate.0 00010000:00010000:2.0:1788664325.175759:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664325.175851:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e2cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4de expref: 48 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.175880:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:2.0:1788664325.175887:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664325.176142:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e2d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.176160:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e2d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.176192:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e2d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664325.176248:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:2.0:1788664325.176272:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c21929c2 reply state 00000000a1b9b5ac transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e2d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.176287:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e2d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.177527:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:2.0:1788664325.177541:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788664325.177549:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788664325.177761:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+50:12276:x1875550119478400:12345-192.168.203.52@tcp:36:truncate.0 Request processed in 2084us (2344us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788664325.177791:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 172 00000020:00080000:2.0:1788664325.177799:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788664325.354430:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664325.354603:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119478528 00000100:00100000:3.0:1788664325.354618:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119478528 00000100:00100000:3.0:1788664325.354758:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 173 00000100:00100000:3.0:1788664325.354815:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+50:12290:x1875550119478528:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:3.0:1788664325.354850:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664325.354879:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e2d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d4e5 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.354976:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e2e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.354995:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e2e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355080:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e2e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355094:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e2e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355103:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355130:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355235:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e2ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355245:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e2ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355253:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e2ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664325.355364:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788664325.355370:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788664325.355398:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e2ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355412:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e2ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355421:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e2e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355428:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e2e0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355447:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e2e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355453:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664325.355458:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e2e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355475:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e2e0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355491:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:3.0:1788664325.355494:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664325.355500:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e2e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355508:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e2e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355525:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355531:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e2e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355536:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e2e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355542:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664325.355544:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e2e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355550:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e2e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355557:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c3027e5400) 00010000:00010000:3.0:1788664325.355560:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664325.355562:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e2e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355580:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e2e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355615:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e2d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4e5 expref: 52 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355632:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e2ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4e5 expref: 51 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.355640:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:3.0:1788664325.355642:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664325.355645:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502b000, rc 0) 00000100:00100000:3.0:1788664325.355976:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+51:12290:x1875550119478528:12345-192.168.203.52@tcp:101:stat.0 Request processed in 1204us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664325.355985:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 173 00000100:00100000:1.0:1788664325.444835:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664325.445012:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119478784 00000100:00100000:3.0:1788664325.445026:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119478784 00000100:00100000:3.0:1788664325.445161:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 174 00000100:00100000:3.0:1788664325.445175:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+51:12300:x1875550119478784:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664325.445207:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664325.445237:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e2f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d4ec expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664325.445398:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788664325.445560:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e2f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4ec expref: 53 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.445602:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c303887300) 00010000:00010000:3.0:1788664325.445605:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664325.445612:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e2f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4ec expref: 53 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.445631:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a200, rc 0) 00000100:00100000:3.0:1788664325.446250:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+52:12300:x1875550119478784:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1075us (1473us total) trans 4294967448 rc 301/301 00000100:00100000:3.0:1788664325.446259:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 174 00000100:00100000:1.0:1788664325.452294:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664325.456089:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119479040 00000100:00100000:3.0:1788664325.456111:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119479040 00000100:00100000:3.0:1788664325.456215:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:3.0:1788664325.456230:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c406b61850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+52:12300:x1875550119479040:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788664325.457112:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c406b61850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+53:12300:x1875550119479040:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 773us (4728us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788664325.457124:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:1.0:1788664325.529717:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664325.529833:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119479296 00000100:00100000:2.0:1788664325.529848:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119479296 00000100:00100000:2.0:1788664325.529929:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 175 00000100:00100000:2.0:1788664325.529941:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+53:12306:x1875550119479296:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788664325.529974:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664325.530012:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e303 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d4f3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.530166:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.530185:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e2ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4e5 expref: 54 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.530217:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.530262:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e2ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4e5 expref: 54 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.530395:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e2ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4e5 expref: 54 pid: 9524 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664325.530413:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304366300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140520704:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664325.530605:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303406b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788664325.535370:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664325.535523:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119479424 00000100:00100000:0.0:1788664325.535537:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119479424 00010000:00010000:0.0:1788664325.535594:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e2ee lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4e5 expref: 55 pid: 9524 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664325.535645:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:0.0:1788664325.535679:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+55:2390:x1875550119479424:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664325.535708:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664325.535717:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e2ee lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4e5 expref: 55 pid: 9524 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.535733:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e2ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4e5 expref: 55 pid: 9524 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.535764:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:0.0:1788664325.535808:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.535824:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.535834:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.535859:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664325.535937:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+55:2390:x1875550119479424:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 260us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664325.535945:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00010000:00010000:2.0:1788664325.541907:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b000/0xcd11f61c1413e2ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4e5 expref: 54 pid: 9524 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664325.541945:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304366300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140520704:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788664325.542132:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.542149:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.542156:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664325.542188:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788664325.543094:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e303 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4f3 expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.543147:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4f3 expref: 54 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.543158:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:2.0:1788664325.543161:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788664325.543165:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0ce00, rc 0) 00000100:00100000:2.0:1788664325.543274:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+54:12306:x1875550119479296:12345-192.168.203.52@tcp:101:bash.0 Request processed in 13334us (13582us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788664325.543284:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 175 00000100:00100000:1.0:1788664325.548209:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664325.548314:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119479680 00000100:00100000:3.0:1788664325.548326:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119479680 00000100:00100000:3.0:1788664325.548399:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 176 00000100:00100000:3.0:1788664325.548411:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+54:12306:x1875550119479680:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:3.0:1788664325.548733:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e318 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.548758:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e318 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.549307:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e318 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788664325.549377:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:3.0:1788664325.549410:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020e77389 reply state 0000000007d4c8c2 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e318 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.549425:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e318 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.549448:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:3.0:1788664325.549451:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788664325.549455:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788664325.549594:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+57:12306:x1875550119479680:12345-192.168.203.52@tcp:36:bash.0 Request processed in 1182us (1395us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788664325.549603:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 176 00000020:00080000:3.0:1788664325.549609:0:9524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788664325.559714:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664325.559820:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119479808 00000100:00100000:3.0:1788664325.559835:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119479808 00000100:00100000:3.0:1788664325.559913:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 177 00000100:00100000:3.0:1788664325.559925:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+57:12306:x1875550119479808:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788664325.559960:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664325.560130:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e31f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d4fa expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.560261:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e326 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.560280:0:9169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4f3 expref: 58 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.560308:0:9169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e326 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.560350:0:9169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4f3 expref: 58 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.560366:0:9169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4f3 expref: 58 pid: 6511 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664325.560382:0:9169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30436bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9169:1875550140520832:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664325.563401:0:9169:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3038a1780 going to sleep for 11 seconds 00010000:00010000:2.0:1788664325.567319:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664325.568634:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664325.570023:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119479936 00000100:00100000:0.0:1788664325.570044:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119479936 00010000:00010000:0.0:1788664325.570107:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4f3 expref: 59 pid: 6511 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664325.570172:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:0.0:1788664325.570184:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:2390:x1875550119479936:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664325.570223:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664325.570231:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4f3 expref: 59 pid: 6511 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.570247:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4f3 expref: 59 pid: 6511 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.570275:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:0.0:1788664325.570281:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e326 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.570295:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e326 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.570305:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e326 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.570330:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664325.570419:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:2390:x1875550119479936:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 237us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664325.570444:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 86 00010000:00010000:2.0:1788664325.573144:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e30a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4f3 expref: 58 pid: 6511 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664325.573181:0:9169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30436bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9169:1875550140520832:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788664325.573215:0:9169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e326 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.573227:0:9169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e326 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.573234:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e326 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664325.573312:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788664325.573319:0:9169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664325.573349:0:9169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e326 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.573881:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a400/0xcd11f61c1413e31f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4fa expref: 58 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.573907:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e326 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4fa expref: 57 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.573918:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:2.0:1788664325.573922:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664325.573927:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a600, rc 0) 00000100:00100000:2.0:1788664325.574113:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+57:12306:x1875550119479808:12345-192.168.203.52@tcp:101:bash.0 Request processed in 14188us (14422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664325.574124:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 177 00000100:00100000:1.0:1788664325.582355:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664325.593858:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119480192 00000100:00100000:0.0:1788664325.593882:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119480192 00000100:00100000:0.0:1788664325.594014:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1788664325.594028:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+57:12306:x1875550119480192:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:0.0:1788664325.594376:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+58:12306:x1875550119480192:12345-192.168.203.52@tcp:35:bash.0 Request processed in 349us (12036us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788664325.594385:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:1.0:1788664325.696369:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140520960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664325.696489:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664325.697936:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140520960 00000100:00100000:0.0:1788664325.697955:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140520960 00000100:00100000:0.0:1788664325.698067:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788664325.698079:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140520960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788664325.698133:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788664325.698244:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140520960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 167us (1755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664325.698253:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788664325.699208:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140520960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664325.735214:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664325.736881:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119480448 00000100:00100000:2.0:1788664325.736902:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119480448 00000100:00100000:2.0:1788664325.737195:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 178 00000100:00100000:2.0:1788664325.737211:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40531aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+58:12316:x1875550119480448:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664325.737246:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664325.737277:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e32d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d501 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664325.737411:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788664325.737557:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e32d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d501 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.737575:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c303887300) 00010000:00010000:2.0:1788664325.737578:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664325.737616:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e32d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d501 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.737636:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0ce00, rc 0) 00000100:00100000:2.0:1788664325.739307:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40531aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:12316:x1875550119480448:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2085us (4104us total) trans 4294967454 rc 301/301 00000100:00100000:2.0:1788664325.739324:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 178 00000100:00100000:1.0:1788664325.744361:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664325.744425:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119480576 00000100:00100000:0.0:1788664325.744447:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119480576 00000100:00100000:0.0:1788664325.744533:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 179 00000100:00100000:0.0:1788664325.744546:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:12316:x1875550119480576:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:0.0:1788664325.744672:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e33b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.744706:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e33b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.744721:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e33b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.744735:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e342 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.744741:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e342 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.744748:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e342 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.744868:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e349 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.744900:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.744908:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664325.744973:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.745005:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e33b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.745013:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e33b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.745021:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e33b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.745027:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664325.745032:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e33b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746312:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e33b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746341:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:0.0:1788664325.746344:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664325.746352:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e33b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746360:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e33b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746406:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e342 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746414:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e342 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746421:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e342 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746427:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957e00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664325.746431:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e342 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746449:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e342 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746459:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c3027e5400) 00010000:00010000:0.0:1788664325.746462:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664325.746466:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e342 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746472:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e342 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746484:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746490:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e349 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746495:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e349 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746507:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957a00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664325.746511:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e349 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746518:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e349 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746527:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:0.0:1788664325.746530:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664325.746533:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e349 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664325.746539:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e349 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664325.746679:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:12316:x1875550119480576:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 2129us (2337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664325.746690:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 179 00000100:00100000:1.0:1788664325.750355:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664325.750660:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119480832 00000100:00100000:0.0:1788664325.750675:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119480832 00000100:00100000:0.0:1788664325.750758:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:0.0:1788664325.750788:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:12316:x1875550119480832:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788664325.753027:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+60:12316:x1875550119480832:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 2242us (2670us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788664325.753116:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:1.0:1788664325.848156:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664325.848425:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119481088 00000100:00100000:2.0:1788664325.848449:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119481088 00000100:00100000:2.0:1788664325.848532:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 180 00000100:00100000:2.0:1788664325.848545:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+60:12319:x1875550119481088:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664325.848580:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664325.848622:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e350 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d508 expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.850401:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e357 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.850443:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e357 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.850459:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e357 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.850475:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e35e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.850483:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e35e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.850490:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e35e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.850673:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e365 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.852185:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.852211:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664325.852231:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788664325.853301:0:9169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e357 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853317:0:9169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e357 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853326:0:9169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e357 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853333:0:9169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664325.853338:0:9169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e357 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853347:0:9169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e357 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853367:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:2.0:1788664325.853372:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664325.853379:0:9169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e357 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853412:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e357 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853444:0:9169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e35e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853451:0:9169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e35e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853456:0:9169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e35e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853461:0:9169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664325.853464:0:9169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e35e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853470:0:9169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e35e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853479:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c3027e5400) 00010000:00010000:2.0:1788664325.853482:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664325.853485:0:9169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e35e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853491:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e35e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853563:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e350 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d508 expref: 63 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853580:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e365 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d508 expref: 62 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.853595:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:2.0:1788664325.853598:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664325.853600:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400030800, rc 0) 00000100:00100000:2.0:1788664325.853720:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+62:12319:x1875550119481088:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 5176us (5699us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788664325.853731:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 180 00000100:00100000:1.0:1788664325.865395:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664325.865462:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664325.865500:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119481216 00000100:00100000:2.0:1788664325.865515:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119481216 00000100:00100000:2.0:1788664325.865658:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 181 00000100:00100000:2.0:1788664325.865671:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c40531ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+62:12319:x1875550119481216:12345-192.168.203.52@tcp:54:lfs.0 00000100:00100000:3.0:1788664325.866157:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119481344 00000100:00100000:3.0:1788664325.866165:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119481344 00000100:00100000:3.0:1788664325.866225:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1788664325.866236:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+63:2393:x1875550119481344:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664325.866251:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664325.866282:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e365 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d508 expref: 63 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664325.866306:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:3.0:1788664325.866313:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664325.866388:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+62:2393:x1875550119481344:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 153us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664325.866397:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00010000:00010000:2.0:1788664325.868925:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e373 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.868964:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e373 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.868982:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e373 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.869044:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e373 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.869051:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e373 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.869059:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e373 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.869065:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030a00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664325.869098:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e373 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.869108:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e373 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.869122:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:2.0:1788664325.869126:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664325.869132:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e373 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664325.869139:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e373 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664325.869567:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c40531ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:12319:x1875550119481216:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 3890us (4179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664325.869581:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 181 00000100:00100000:1.0:1788664325.878925:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664325.879018:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119481600 00000100:00100000:3.0:1788664325.879031:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119481600 00000100:00100000:3.0:1788664325.879194:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:3.0:1788664325.879207:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:12319:x1875550119481600:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788664325.879569:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+62:12319:x1875550119481600:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 364us (661us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788664325.879579:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:2.0:1788664326.093051:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664326.093142:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119481856 00000100:00100000:0.0:1788664326.093155:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119481856 00000100:00100000:0.0:1788664326.093233:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 182 00000100:00100000:0.0:1788664326.093267:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+62:12337:x1875550119481856:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:0.0:1788664326.093319:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664326.093348:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e37a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d50f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.093509:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e381 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.093529:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e381 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.093544:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e381 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664326.093558:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788664326.093725:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e37a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d50f expref: 65 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.093751:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e381 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d50f expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.093762:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:0.0:1788664326.093765:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788664326.093821:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957800, rc 0) 00000100:00100000:0.0:1788664326.093898:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+64:12337:x1875550119481856:12345-192.168.203.52@tcp:101:cat.0 Request processed in 634us (863us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788664326.093907:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 182 00000001:00080000:0.0:1788664326.101902:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:0.0:1788664326.101948:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788664326.101991:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c403ce8cc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788664326.101996:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c4081a3d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c419920840 00000020:00080000:0.0:1788664326.102000:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c4081a3700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c304363800 00000020:00080000:3.0:1788664326.102602:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1788664326.102620:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140521088:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1788664326.102686:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788664326.102764:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664326.102911:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e166 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.102927:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e166 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.102958:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e166 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.102967:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664326.102974:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e166 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103003:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e166 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103025:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93c3027e5600) 00010000:00010000:1.0:1788664326.103028:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664326.103035:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e166 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103043:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e166 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103069:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e16d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103075:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e16d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103081:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e16d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103087:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664326.103090:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e16d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103107:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e16d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103116:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:1.0:1788664326.103119:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664326.103122:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e16d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103127:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e16d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103143:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e1ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103150:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e1ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103156:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e1ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103161:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84a00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664326.103164:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e1ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103171:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e1ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103177:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c3027e5400) 00010000:00010000:1.0:1788664326.103180:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664326.103182:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e1ac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103194:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e1ac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103212:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e2af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103218:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e2af lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103224:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e2af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103229:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664326.103232:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e2af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103239:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e2af lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103248:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:1.0:1788664326.103251:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664326.103254:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e2af lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103260:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e2af lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103272:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e2d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103287:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e2d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103429:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e2d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103444:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ca00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664326.103448:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e2d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103454:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e2d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103463:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:1.0:1788664326.103466:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664326.103469:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e2d2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103475:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e2d2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103488:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e318 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103495:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e318 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103502:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e318 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103508:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664326.103510:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e318 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103528:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e318 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103537:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:1.0:1788664326.103540:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664326.103543:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e318 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664326.103549:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a200/0xcd11f61c1413e318 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664326.103633:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140521088 00000100:00100000:2.0:1788664326.103645:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140521088 00000100:00100000:2.0:1788664326.103736:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788664326.103748:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1875550140521088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788664326.103826:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1788664326.103868:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9cda03, atime: 0x6a9cda03, ctime: 0x6a9cda03, blocks: 0x8 00010000:00010000:2.0:1788664326.103877:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025d55974/0xcd11f61c1413e38f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664326.103895:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1788664326.103901:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664326.103909:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025d55974/0xcd11f61c1413e38f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664326.103936:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025d55974/0xcd11f61c1413e38f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664326.103946:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025d55974/0xcd11f61c1413e38f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664326.103954:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025d55974/0xcd11f61c1413e38f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664326.103976:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1788664326.104106:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788664326.104115:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664326.104129:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025d55974/0xcd11f61c1413e38f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.104149:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664326.104154:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d55974/0xcd11f61c1413e38f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.104166:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d55974/0xcd11f61c1413e38f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.104189:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025d55974/0xcd11f61c1413e38f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.104198:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025d55974/0xcd11f61c1413e38f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.104229:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664326.104232:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664326.104235:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664326.104422:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3637:x1875550140521088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 675us (1656us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788664326.104583:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:0.0:1788664326.106370:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c304364380/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788664326.106402:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140521088:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788664326.124882:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664326.125808:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119481984 00000100:00100000:2.0:1788664326.125819:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119481984 00000100:00100000:2.0:1788664326.125883:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 183 00000100:00100000:2.0:1788664326.125893:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:12338:x1875550119481984:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664326.125917:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664326.125938:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e396 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d516 expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664326.126002:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e39d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664326.126015:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e39d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664326.126044:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e39d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664326.126088:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788664326.126092:0:9169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664326.126110:0:9169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e39d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664326.126136:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e396 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d516 expref: 20 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664326.126155:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e39d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d516 expref: 19 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664326.126164:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:2.0:1788664326.126167:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664326.126170:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400030a00, rc 0) 00000100:00100000:2.0:1788664326.126676:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:12338:x1875550119481984:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 783us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664326.126692:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 183 00000100:00100000:1.0:1788664326.139320:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664326.139411:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119482368 00000100:00100000:3.0:1788664326.139421:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119482368 00000100:00100000:3.0:1788664326.139539:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:3.0:1788664326.139550:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:12338:x1875550119482368:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788664326.139910:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:12338:x1875550119482368:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 361us (598us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788664326.139919:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:1.0:1788664326.154582:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664326.154811:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119482496 00000100:00100000:3.0:1788664326.154822:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119482496 00000100:00100000:3.0:1788664326.154889:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1788664326.154899:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:12338:x1875550119482496:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:3.0:1788664326.154916:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788664326.154941:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e326 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4fa expref: 20 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664326.154963:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e381 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d50f expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664326.154976:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e223 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4b4 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664326.155015:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:3.0:1788664326.155021:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664326.155080:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:12338:x1875550119482496:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 183us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664326.155088:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1788664326.158135:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664326.158220:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119482624 00000100:00100000:2.0:1788664326.158229:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119482624 00000100:00100000:2.0:1788664326.158282:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:2.0:1788664326.158291:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:12338:x1875550119482624:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:2.0:1788664326.158424:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e3a4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664326.158454:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e3a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664326.158471:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e3a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788664326.158564:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788664326.158639:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:12338:x1875550119482624:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 349us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664326.158648:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:2.0:1788664326.206367:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140521600:0@lo:400:kworker.0 00000100:00100000:2.0:1788664326.206446:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664326.206765:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140522112:0@lo:400:kworker.0 00000100:00100000:2.0:1788664326.206816:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664326.206835:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304275880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140522624:0@lo:400:kworker.0 00000100:00100000:2.0:1788664326.206855:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664326.206877:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788664326.206882:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140521472:0@lo:400:kworker.0 00000100:00100000:2.0:1788664326.206905:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664326.206919:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140521984:0@lo:400:kworker.0 00000100:00100000:2.0:1788664326.206939:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664326.206957:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140522496:0@lo:400:kworker.0 00000100:00100000:2.0:1788664326.206975:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664326.207067:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140522112 00000100:00100000:2.0:1788664326.207074:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140522112 00000100:00100000:2.0:1788664326.207118:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140522624 00000100:00100000:2.0:1788664326.207120:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140522624 00000100:00100000:2.0:1788664326.207131:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140522496 00000100:00100000:2.0:1788664326.207132:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140522496 00000100:00100000:2.0:1788664326.207156:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788664326.207163:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140522112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664326.207219:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140522112:12345-0@lo:400:kworker.0 Request processed in 55us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664326.207226:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788664326.207241:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788664326.207247:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140522624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664326.207275:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140522624:12345-0@lo:400:kworker.0 Request processed in 29us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664326.207281:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788664326.207292:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788664326.207298:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140522496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664326.207324:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140522496:12345-0@lo:400:kworker.0 Request processed in 26us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664326.207329:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788664326.207368:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140522496:0@lo:400:kworker.0 00000100:00100000:2.0:1788664326.207379:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140522112:0@lo:400:kworker.0 00000100:00100000:2.0:1788664326.207388:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304275880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140522624:0@lo:400:kworker.0 00000100:00100000:3.0:1788664326.207824:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140521344:0@lo:400:kworker.0 00000100:00100000:3.0:1788664326.207861:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664326.207889:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140521856:0@lo:400:kworker.0 00000100:00100000:3.0:1788664326.207911:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664326.207931:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140522368:0@lo:400:kworker.0 00000100:00100000:3.0:1788664326.207951:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664326.207971:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788664326.207978:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140521216:0@lo:400:kworker.0 00000100:00100000:3.0:1788664326.208016:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664326.208040:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140521728:0@lo:400:kworker.0 00000100:00100000:3.0:1788664326.208063:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664326.208079:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140522240:0@lo:400:kworker.0 00000100:00100000:3.0:1788664326.208098:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664326.208118:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140521216 00000100:00100000:3.0:1788664326.208122:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140521216 00000100:00100000:3.0:1788664326.208153:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788664326.208160:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140521216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664326.208197:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140521216:12345-0@lo:400:kworker.0 Request processed in 38us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664326.208213:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788664326.208252:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140521600 00000100:00100000:3.0:1788664326.208256:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140521600 00000100:00100000:3.0:1788664326.208271:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140521984 00000100:00100000:3.0:1788664326.208274:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140521984 00000100:00100000:3.0:1788664326.208285:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140521344 00000100:00100000:3.0:1788664326.208287:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140521344 00000100:00100000:3.0:1788664326.208297:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140521856 00000100:00100000:3.0:1788664326.208299:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140521856 00000100:00100000:3.0:1788664326.208309:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140522368 00000100:00100000:3.0:1788664326.208311:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140522368 00000100:00100000:3.0:1788664326.208320:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140522240 00000100:00100000:3.0:1788664326.208322:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140522240 00000100:00100000:3.0:1788664326.208334:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788664326.208341:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140521600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664326.208375:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140521600:12345-0@lo:400:kworker.0 Request processed in 36us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664326.208381:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788664326.208392:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788664326.208397:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140521984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664326.208422:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140521984:12345-0@lo:400:kworker.0 Request processed in 25us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664326.208427:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788664326.208449:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788664326.208455:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140521344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664326.208482:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140521344:12345-0@lo:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664326.208488:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00080000:1.0:1788664326.208848:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788664326.208853:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664326.208855:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664326.208858:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664326.208869:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140521472 00000100:00100000:1.0:1788664326.208872:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140521472 00000100:00100000:1.0:1788664326.208902:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140521728 00000100:00100000:1.0:1788664326.208906:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140521728 00000100:00100000:1.0:1788664326.208918:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788664326.208925:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140521472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664326.208963:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140521472:12345-0@lo:400:kworker.0 Request processed in 39us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664326.208968:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788664326.208980:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788664326.209006:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140521728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664326.209037:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140521728:12345-0@lo:400:kworker.0 Request processed in 46us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664326.209043:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788664326.209112:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140522752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664326.209145:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664326.209242:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664326.209282:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119482752 00000100:00100000:0.0:1788664326.209286:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119482752 00000100:00100000:2.0:1788664326.209349:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140522752 00000100:00100000:2.0:1788664326.209353:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140522752 00000100:00100000:2.0:1788664326.209382:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788664326.209390:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140522752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664326.209413:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788664326.209463:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140522752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664326.209476:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788664326.209527:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140522752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664326.209555:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140521472:0@lo:400:kworker.0 00010000:00080000:2.0:1788664326.209571:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c304365c00 x1875550140521984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664326.209581:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140521984:0@lo:400:kworker.0 00000100:00100000:2.0:1788664326.209592:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140521600:0@lo:400:kworker.0 00000100:00100000:1.0:1788664326.210390:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788664326.210404:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140521856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664326.210470:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140521856:12345-0@lo:400:kworker.0 Request processed in 72us (2558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664326.210477:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788664326.210506:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788664326.210513:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140522368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664326.210541:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140522368:12345-0@lo:400:kworker.0 Request processed in 30us (2589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664326.210547:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788664326.210559:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788664326.210565:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30436bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140522240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664326.210593:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30436bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140522240:12345-0@lo:400:kworker.0 Request processed in 29us (2494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664326.210599:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788664326.210656:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140521216:0@lo:400:kworker.0 00000100:00100000:1.0:1788664326.210669:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140521728:0@lo:400:kworker.0 00000100:00100000:1.0:1788664326.210688:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140522240:0@lo:400:kworker.0 00000100:00100000:1.0:1788664326.210700:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140521344:0@lo:400:kworker.0 00000100:00100000:1.0:1788664326.210725:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140521856:0@lo:400:kworker.0 00010000:00080000:1.0:1788664326.210736:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c304366680 x1875550140522368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664326.210746:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140522368:0@lo:400:kworker.0 00000100:00100000:0.0:1788664326.212184:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:0.0:1788664326.212204:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+17:12340:x1875550119482752:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664326.215641:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664326.215675:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e3ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d51d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.215758:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e3b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.215787:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e3b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.215799:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e3b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.215816:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e3b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.215822:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.215829:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.215914:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e3c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.215923:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.215930:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664326.215972:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788664326.215976:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788664326.218126:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218150:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218162:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e3b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218169:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e3b2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218176:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e3b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218182:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664326.218186:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e3b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218194:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e3b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218237:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:0.0:1788664326.218240:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664326.218246:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e3b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218253:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e3b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218271:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218277:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e3b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218283:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e3b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218288:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664326.218291:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e3b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218297:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e3b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218305:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c303887000) 00010000:00010000:0.0:1788664326.218307:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664326.218310:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e3b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218316:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e3b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218380:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e3ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d51d expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218394:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d51d expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664326.218402:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:0.0:1788664326.218404:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664326.218406:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956c00, rc 0) 00000100:00100000:0.0:1788664326.218488:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:12340:x1875550119482752:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 6292us (9246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664326.218508:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 185 00010000:00010000:3.0:1788664326.591064:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664326.718017:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664326.718046:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140522880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788664326.718136:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664326.718448:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140522880 00000100:00100000:3.0:1788664326.718459:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140522880 00000100:00100000:3.0:1788664326.718527:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788664326.718539:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30436aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140522880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788664326.718571:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788664326.718631:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30436aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140522880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664326.718639:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788664326.718706:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140522880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664326.814484:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664326.814546:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664326.814588:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664326.814622:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664326.814650:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664326.814677:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664326.814710:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664326.814745:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119483392 00000100:00100000:1.0:1788664326.814757:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119483392 00000100:00100000:0.0:1788664326.814926:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119483136 00000100:00100000:0.0:1788664326.814932:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119483136 00000100:00100000:0.0:1788664326.815009:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119483648 00000100:00100000:0.0:1788664326.815012:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119483648 00000100:00100000:0.0:1788664326.815029:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119483008 00000100:00100000:0.0:1788664326.815032:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119483008 00000100:00100000:0.0:1788664326.815044:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119483520 00000100:00100000:0.0:1788664326.815047:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119483520 00000100:00100000:0.0:1788664326.815065:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 362 00000100:00100000:0.0:1788664326.815075:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119483136:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664326.815181:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2391:x1875550119483136:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 106us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664326.815188:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 362 00000100:00100000:0.0:1788664326.815207:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 363 00000100:00100000:0.0:1788664326.815213:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119483648:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664326.815271:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119483648:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 58us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664326.815277:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 363 00000100:00100000:0.0:1788664326.815287:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 364 00000100:00100000:0.0:1788664326.815292:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:2391:x1875550119483008:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664326.815313:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:2391:x1875550119483008:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 20us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664326.815319:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 364 00000100:00100000:0.0:1788664326.815329:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 365 00000100:00100000:0.0:1788664326.815335:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119483520:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664326.815358:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119483520:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 22us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664326.815363:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 365 00000100:00080000:0.0:1788664326.815384:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664326.815388:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788664326.815890:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119482880 00000100:00100000:3.0:1788664326.815896:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119482880 00000100:00100000:3.0:1788664326.815938:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 396 00000100:00100000:3.0:1788664326.815946:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2391:x1875550119482880:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664326.815998:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2391:x1875550119482880:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 53us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664326.816004:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 396 00000100:00100000:1.0:1788664326.816608:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119483264 00000100:00100000:1.0:1788664326.816618:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119483264 00000100:00100000:1.0:1788664326.816642:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:1.0:1788664326.816650:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119483392:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664326.816697:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119483392:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 47us (2109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664326.816704:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:1.0:1788664326.816718:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 153 00000100:00100000:1.0:1788664326.816724:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119483264:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664326.816752:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119483264:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664326.816758:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 153 00000100:00080000:3.0:1788664326.817173:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664326.817179:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788664327.167747:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788664327.167760:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788664327.167837:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788664327.167848:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788664327.168039:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e978380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1875550140523008:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788664327.168162:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3010869c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664327.176094:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664327.176333:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119483776 00000100:00100000:3.0:1788664327.176346:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119483776 00000100:00100000:3.0:1788664327.176456:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 186 00000100:00100000:3.0:1788664327.176469:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:12351:x1875550119483776:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788664327.176513:0:9169:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788664327.180185:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e978380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1875550140523008:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00080000:1.0:1788664327.180533:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664327.186319:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:12351:x1875550119483776:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 9837us (10225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664327.186337:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 186 00000100:00100000:0.0:1788664327.191667:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664327.191768:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119483904 00000100:00100000:1.0:1788664327.191804:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119483904 00000100:00100000:1.0:1788664327.191887:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:1.0:1788664327.191901:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:12351:x1875550119483904:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788664327.192013:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e3c7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192036:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e3c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192053:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e3c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192394:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e3ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192419:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e3ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192440:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e3ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192479:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e3d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192488:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192495:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664327.192563:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788664327.192568:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664327.192582:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192595:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e3c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192670:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e3c7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192678:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e3c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192688:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664327.192694:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e3c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192701:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e3c7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192715:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c4350d6600) 00010000:00010000:1.0:1788664327.192719:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664327.192725:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e3c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192733:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e3c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192749:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e3ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192768:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e3ce lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192813:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e3ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192818:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84a00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664327.192821:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e3ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192827:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e3ce lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192837:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff93c4047be000) 00010000:00010000:1.0:1788664327.192839:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664327.192842:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e3ce lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192847:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413e3ce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192931:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192939:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e3d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192945:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192950:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664327.192961:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192969:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e3d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192980:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:1.0:1788664327.192983:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664327.192986:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e3d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.192991:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84800/0xcd11f61c1413e3d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664327.193170:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:12351:x1875550119483904:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 1267us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664327.193183:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:1.0:1788664327.204936:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664327.205103:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119484160 00000100:00100000:2.0:1788664327.205126:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119484160 00000100:00100000:2.0:1788664327.205191:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:2.0:1788664327.205203:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:12351:x1875550119484160:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664327.205224:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664327.205245:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e3dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d524 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.205366:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e3e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.205383:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.205394:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664327.205432:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788664327.205519:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.205527:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e3e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.205534:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.205540:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ca00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664327.205544:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.205553:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e3e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.205564:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:2.0:1788664327.205568:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664327.205572:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e3e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.205578:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e3e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.205618:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e3dc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d524 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.205630:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c4350d6600) 00010000:00010000:2.0:1788664327.205632:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664327.205644:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e3dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d524 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.205656:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400030800, rc 0) 00000100:00100000:2.0:1788664327.205725:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:12351:x1875550119484160:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 524us (800us total) trans 4294967460 rc 301/301 00000100:00100000:2.0:1788664327.205733:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:1.0:1788664327.220359:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664327.220453:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119484288 00000100:00100000:1.0:1788664327.220467:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119484288 00000100:00100000:1.0:1788664327.220554:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:1.0:1788664327.220569:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:12351:x1875550119484288:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788664327.220626:0:6511:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788664327.220827:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:12351:x1875550119484288:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 259us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664327.220837:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:1.0:1788664327.225808:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664327.227217:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119484544 00000100:00100000:0.0:1788664327.227234:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119484544 00000100:00100000:0.0:1788664327.227331:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:0.0:1788664327.227346:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:12351:x1875550119484544:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664327.227383:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664327.227388:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788664327.227462:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e39d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d516 expref: 19 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.227494:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:0.0:1788664327.227502:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664327.227521:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e3f1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d52b expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664327.230715:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788664327.230739:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140523136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788664327.230860:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664327.230983:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140523136 00000100:00100000:1.0:1788664327.230997:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140523136 00000100:00100000:1.0:1788664327.231058:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788664327.231067:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30436ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140523136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664327.231106:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788664327.231172:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30436ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140523136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664327.231180:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000004:00080000:0.0:1788664327.231191:0:9524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00000100:00100000:1.0:1788664327.231229:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140523136:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788664327.231505:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e3f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.231528:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.231543:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.231649:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e3f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d52b expref: 21 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.231678:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d52b expref: 20 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.232025:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93c303887000) 00010000:00010000:0.0:1788664327.232485:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664327.232493:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956600, rc 0) 00000100:00100000:0.0:1788664327.232590:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:12351:x1875550119484544:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 5245us (6825us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788664327.232601:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:1.0:1788664327.239859:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664327.240079:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119484800 00000100:00100000:0.0:1788664327.240089:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119484800 00000100:00100000:0.0:1788664327.240149:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:0.0:1788664327.240221:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:12351:x1875550119484800:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788664327.240278:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664327.240490:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e3f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d52b expref: 20 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.240507:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93c303887000) 00010000:00010000:0.0:1788664327.240518:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664327.240540:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e406 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.240554:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e406 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.240564:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e406 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.240578:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e40d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x27d38be4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.241515:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e40d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x27d38be4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.241524:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e40d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x27d38be4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.241575:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e406 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.242439:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e406 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.242452:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e406 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.242459:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664327.242464:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e406 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.242472:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e406 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.242485:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:0.0:1788664327.242489:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664327.242494:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e406 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.242500:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e406 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.242514:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e40d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x27d38be4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.242528:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e40d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x27d38be4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.242534:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e40d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x27d38be4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.242540:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664327.242544:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e40d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x27d38be4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.242550:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e40d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x27d38be4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.242558:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x27d38be4 (ffff93c303887100) 00010000:00010000:0.0:1788664327.242560:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664327.242562:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e40d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x27d38be4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.242567:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e40d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x27d38be4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664327.243856:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:12351:x1875550119484800:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 3690us (3995us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788664327.243868:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:2.0:1788664327.250433:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664327.250476:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119484928 00000100:00100000:2.0:1788664327.250486:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119484928 00000100:00100000:2.0:1788664327.250558:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00100000:2.0:1788664327.250571:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:12351:x1875550119484928:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664327.250596:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664327.250621:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e414 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d532 expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.251166:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e41b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.251183:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e41b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.251558:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e41b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.251716:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e414 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d532 expref: 21 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.251734:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e41b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d532 expref: 20 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.251751:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93c4130a6000) 00010000:00010000:2.0:1788664327.251754:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788664327.251758:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c600, rc 0) 00000100:00100000:2.0:1788664327.251839:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:12351:x1875550119484928:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1271us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664327.251848:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00100000:0.0:1788664327.264536:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664327.264578:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119485184 00000100:00100000:0.0:1788664327.264591:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119485184 00000100:00100000:0.0:1788664327.264648:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 193 00000100:00100000:0.0:1788664327.264658:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:12351:x1875550119485184:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788664327.264808:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e422 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.264827:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e422 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.264841:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e422 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788664327.265036:0:9524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788664327.265046:0:9524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 422402274418ns, next at 423402271526ns, rc = 0 00000004:00010000:0.0:1788664327.265098:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000407ff0cd reply state 000000004fb10425 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e422 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.265111:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e422 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.265118:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93c4130a6000) 00010000:00010000:0.0:1788664327.265122:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788664327.265126:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000040:00080000:2.0:1788664327.265228:0:14654:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000100:00100000:0.0:1788664327.265229:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:12351:x1875550119485184:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 572us (702us total) trans 4294967462 rc 0/0 00000040:00080000:2.0:1788664327.265235:0:14654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788664327.265242:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 193 00000040:00080000:2.0:1788664327.265265:0:14654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788664327.265272:0:14654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788664327.271301:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664327.271817:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119485312 00000100:00100000:0.0:1788664327.271828:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119485312 00000100:00100000:0.0:1788664327.271884:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:0.0:1788664327.271894:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:12351:x1875550119485312:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664327.271917:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664327.271936:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e429 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d539 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.272003:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e429 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d539 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.272017:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e429 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d539 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.272157:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93c4130a6000) 00010000:00010000:0.0:1788664327.272161:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664327.272165:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957200, rc 0) 00000100:00100000:0.0:1788664327.273006:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+23:12351:x1875550119485312:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1103us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664327.273018:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:1.0:1788664327.279480:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664327.279601:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119485440 00000100:00100000:3.0:1788664327.279619:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119485440 00000100:00100000:3.0:1788664327.279703:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:3.0:1788664327.279716:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2393:x1875550119485440:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788664327.280443:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2393:x1875550119485440:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 726us (966us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788664327.280455:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:2.0:1788664327.295886:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664327.296053:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119485696 00000100:00100000:1.0:1788664327.296063:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119485696 00000100:00100000:1.0:1788664327.296124:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:1.0:1788664327.296133:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+23:12351:x1875550119485696:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788664327.296375:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:12351:x1875550119485696:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 241us (497us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1788664327.296385:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:1.0:1788664327.304201:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664327.304267:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119485952 00000100:00100000:2.0:1788664327.304277:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119485952 00000100:00100000:2.0:1788664327.304343:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:2.0:1788664327.304353:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:12351:x1875550119485952:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788664327.304490:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:12351:x1875550119485952:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 137us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664327.304498:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:1.0:1788664327.314637:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664327.314713:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119486080 00000100:00100000:0.0:1788664327.314733:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119486080 00000100:00100000:0.0:1788664327.314849:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:0.0:1788664327.314862:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:12351:x1875550119486080:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664327.314901:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664327.314929:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e430 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d540 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.315158:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e437 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.315180:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.315193:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664327.315267:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664327.315299:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.315347:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e430 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d540 expref: 26 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.315367:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e437 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d540 expref: 25 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.315380:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93c4130a6000) 00010000:00010000:1.0:1788664327.315383:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788664327.315388:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85800, rc 0) 00000100:00100000:1.0:1788664327.315495:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:12351:x1875550119486080:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 635us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664327.315504:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:3.0:1788664327.326594:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664327.326657:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119486208 00000100:00100000:3.0:1788664327.326671:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119486208 00000100:00100000:3.0:1788664327.326755:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:3.0:1788664327.335194:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2393:x1875550119486208:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664327.336665:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664327.336708:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413e43e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d547 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788664327.336751:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cda07, blocks: 0x0 00010000:00010000:3.0:1788664327.336811:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788664327.336818:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664327.336835:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413e43e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d547 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.336861:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413e43e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d547 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.336892:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a600, rc 0) 00000100:00100000:3.0:1788664327.336996:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2393:x1875550119486208:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 10227us (10417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664327.337007:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:0.0:1788664327.341190:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664327.341357:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119486464 00000100:00100000:2.0:1788664327.341367:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119486464 00000100:00100000:2.0:1788664327.341441:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 197 00000100:00100000:2.0:1788664327.341453:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:12351:x1875550119486464:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788664327.341556:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:12351:x1875550119486464:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 105us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664327.341573:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 197 00000100:00100000:3.0:1788664327.344552:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664327.345389:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119486592 00000100:00100000:3.0:1788664327.345401:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119486592 00000100:00100000:3.0:1788664327.345461:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:3.0:1788664327.345471:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:12351:x1875550119486592:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664327.345489:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664327.345506:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bf76d02/0xcd11f61c1413e445 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d54e expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.345537:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413e43e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d547 expref: 9 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.345548:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664327.345552:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664327.345558:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bf76d02/0xcd11f61c1413e445 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d54e expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.345598:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413e43e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d547 expref: 9 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.345629:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413e43e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d547 expref: 9 pid: 8426 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664327.345644:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1875550140523264:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664327.345744:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3038a1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664327.354542:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664327.354585:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119486720 00000100:00100000:0.0:1788664327.354593:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119486720 00010000:00010000:0.0:1788664327.354630:0:10332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413e43e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d547 expref: 10 pid: 8426 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664327.354692:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:0.0:1788664327.354702:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:2391:x1875550119486720:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664327.354717:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664327.354738:0:10332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413e43e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d547 expref: 10 pid: 8426 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.354752:0:10332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413e43e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d547 expref: 10 pid: 8426 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.354793:0:10332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664327.354798:0:10332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664327.354807:0:10332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006bf76d02/0xcd11f61c1413e445 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d54e expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.354816:0:10332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bf76d02/0xcd11f61c1413e445 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d54e expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.354852:0:10332:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006bf76d02/0xcd11f61c1413e445 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d54e expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664327.354867:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10332:1875550140523392:192.168.203.52@tcp:105: 00000100:00100000:0.0:1788664327.354940:0:10332:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3010866c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788664327.355570:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413e43e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d547 expref: 10 pid: 8426 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664327.355587:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1875550140523264:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664327.355613:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006bf76d02/0xcd11f61c1413e445 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d54e expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.355625:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502b800, rc 0) 00000100:00100000:3.0:1788664327.355687:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:12351:x1875550119486592:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 10217us (11143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664327.355696:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:0.0:1788664327.357454:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10332:1875550140523392:192.168.203.52@tcp:105: 00010000:00010000:0.0:1788664327.357486:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664327.357529:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2391:x1875550119486720:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 2827us (2995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664327.357539:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:0.0:1788664327.359605:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664327.360432:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119486848 00000100:00100000:3.0:1788664327.360444:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119486848 00002000:00100000:3.0:1788664327.360498:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff93c3036f9180 x1875550119486848/t0(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:633/0 lens 504/0 e 0 to 0 dl 1788664338 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788664327.360511:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c3036f9180 with x1875550119486848 ext(0->8) 00002000:00010000:3.0:1788664327.360518:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c3036f9180 00000100:00100000:3.0:1788664327.360546:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1788664327.360565:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2390:x1875550119486848:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788664327.367214:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:2390:x1875550119486848:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 6641us (7611us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788664327.367229:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00002000:00100000:2.0:1788664327.367243:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff93c3036f9180 x1875550119486848/t4294967315(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:633/0 lens 504/448 e 0 to 0 dl 1788664338 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664327.367253:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c3036f9180 with x1875550119486848 ext(0->8) 00002000:00010000:2.0:1788664327.367260:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c3036f9180 00000100:00100000:0.0:1788664327.375298:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664327.375436:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119486976 00000100:00100000:1.0:1788664327.375447:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119486976 00000100:00100000:1.0:1788664327.375508:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 198 00000100:00100000:1.0:1788664327.375519:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:12351:x1875550119486976:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788664327.380703:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:1.0:1788664327.380720:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788664327.380745:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:1.0:1788664327.380813:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e422 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.380825:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e422 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.380846:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e422 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.380855:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664327.380859:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e422 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.380867:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e422 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.380886:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93c4130a6000) 00010000:00010000:1.0:1788664327.380890:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788664327.380896:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e422 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.380904:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e422 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788664327.381014:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788664327.381039:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788664327.381060:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3041b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140523520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788664327.381132:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664327.381191:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140523520 00000100:00100000:1.0:1788664327.381198:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140523520 00000100:00100000:1.0:1788664327.381244:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788664327.381255:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140523520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788664327.381395:0:9895:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788664327.381398:0:9895:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788664327 00002000:00010000:1.0:1788664327.381401:0:9895:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788664327.381409:0:9895:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788664327 -> 1788664327 00002000:00010000:1.0:1788664327.381412:0:9895:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788664327.381460:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1875550140523520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 206us (327us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788664327.381467:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:1.0:1788664327.381511:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c3041b8a80/2, rc 0, transno 4294967316 00000100:00100000:1.0:1788664327.381517:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3041b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140523520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788664327.381611:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:12351:x1875550119486976:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 6092us (6329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664327.381619:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 198 00000100:00100000:1.0:1788664327.388304:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664327.388571:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119487104 00000100:00100000:3.0:1788664327.388583:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119487104 00000100:00100000:3.0:1788664327.388638:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:3.0:1788664327.388647:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:2392:x1875550119487104:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788664327.394132:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1788664327.394148:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1788664327.394528:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2392:x1875550119487104:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 5875us (6235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664327.394540:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:1.0:1788664327.401961:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664327.402043:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119487360 00000100:00100000:3.0:1788664327.402054:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119487360 00000100:00100000:3.0:1788664327.402122:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 199 00000100:00100000:3.0:1788664327.402133:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:12351:x1875550119487360:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788664327.402185:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664327.402213:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85800/0xcd11f61c1413e437 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d540 expref: 19 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.402230:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93c4130a6000) 00010000:00010000:3.0:1788664327.402236:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664327.402266:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e44c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.402281:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e44c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.402301:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e44c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664327.402455:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f34ac9f1 reply state 00000000cecf199f transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e44c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.402484:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e44c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.402490:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93c4130a6000) 00010000:00010000:3.0:1788664327.402493:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788664327.402495:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788664327.402585:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:12351:x1875550119487360:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 453us (632us total) trans 4294967464 rc 0/0 00000100:00100000:3.0:1788664327.402793:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 199 00000100:00100000:0.0:1788664327.407993:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664327.411612:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119487488 00000100:00100000:2.0:1788664327.411626:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119487488 00000100:00100000:2.0:1788664327.411689:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:2.0:1788664327.411698:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119487488:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788664327.411874:0:9895:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788664327.411878:0:9895:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788664327 -> 1788664325 00002000:00010000:2.0:1788664327.411881:0:9895:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788664323 00002000:00010000:2.0:1788664327.411883:0:9895:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788664327 -> 1788664325 00002000:00010000:2.0:1788664327.411885:0:9895:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788664327.411948:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2391:x1875550119487488:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 251us (3964us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788664327.411955:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:0.0:1788664327.417765:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664327.417854:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119487744 00000100:00100000:2.0:1788664327.417863:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119487744 00000100:00100000:2.0:1788664327.417923:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:2.0:1788664327.417934:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:12351:x1875550119487744:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788664327.418009:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e453 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.418036:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e41b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d532 expref: 20 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.418047:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e453 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.418079:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e41b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d532 expref: 20 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.418093:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e41b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d532 expref: 20 pid: 9169 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664327.418107:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304276a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875550140523648:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664327.418191:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303406600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664327.421728:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664327.424224:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304276a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875550140523648:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788664327.424255:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e453 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664327.424503:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119487872 00000100:00100000:1.0:1788664327.424511:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119487872 00010000:00010000:1.0:1788664327.424553:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e41b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d532 expref: 21 pid: 9169 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664327.424629:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:1.0:1788664327.424639:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c412c70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:2390:x1875550119487872:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664327.424654:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664327.424661:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e41b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d532 expref: 21 pid: 9169 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.424672:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e41b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d532 expref: 21 pid: 9169 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.424700:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e41b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d532 expref: 21 pid: 9169 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.424713:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93c4130a6000) 00010000:00010000:1.0:1788664327.424717:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e453 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.424727:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e453 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.424734:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e453 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.424762:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664327.424835:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c412c70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:2390:x1875550119487872:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 196us (3116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664327.424844:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 88 00010000:00010000:0.0:1788664327.425472:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e453 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.425484:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e453 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.425523:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e453 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.425531:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e453 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.425539:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e453 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.425547:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664327.425552:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e453 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.425572:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e453 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.425584:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93c4130a6000) 00010000:00010000:0.0:1788664327.425587:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788664327.425591:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e453 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.425597:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e453 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664327.425663:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:12351:x1875550119487744:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 7730us (7905us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788664327.425672:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:3.0:1788664327.435075:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664327.435147:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119488000 00000100:00100000:0.0:1788664327.435156:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119488000 00000100:00100000:0.0:1788664327.435214:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:0.0:1788664327.435225:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2391:x1875550119488000:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788664327.435270:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009056a327/0xcd11f61c1413e45a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.435291:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006bf76d02/0xcd11f61c1413e445 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d54e expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.435300:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664327.435304:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664327.435309:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009056a327/0xcd11f61c1413e45a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.435360:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006bf76d02/0xcd11f61c1413e445 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d54e expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.435374:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006bf76d02/0xcd11f61c1413e445 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d54e expref: 8 pid: 8428 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664327.435389:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303740380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1875550140523776:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788664327.435478:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3010866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664327.442451:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664327.442487:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119488128 00000100:00100000:1.0:1788664327.442497:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119488128 00010000:00010000:1.0:1788664327.442537:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006bf76d02/0xcd11f61c1413e445 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d54e expref: 9 pid: 8428 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664327.442574:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:1.0:1788664327.442584:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30436a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2390:x1875550119488128:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664327.442598:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664327.442618:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006bf76d02/0xcd11f61c1413e445 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d54e expref: 9 pid: 8428 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.442645:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006bf76d02/0xcd11f61c1413e445 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d54e expref: 9 pid: 8428 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.442669:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664327.442674:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664327.442680:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009056a327/0xcd11f61c1413e45a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.442690:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009056a327/0xcd11f61c1413e45a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.442712:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664327.442766:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30436a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2390:x1875550119488128:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 182us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664327.442802:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 89 00010000:00010000:3.0:1788664327.443143:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bf76d02/0xcd11f61c1413e445 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d54e expref: 8 pid: 8428 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664327.443159:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303740380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1875550140523776:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664327.443180:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009056a327/0xcd11f61c1413e45a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.443191:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009056a327/0xcd11f61c1413e45a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.443199:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009056a327/0xcd11f61c1413e45a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.443220:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009056a327/0xcd11f61c1413e45a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.443240:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009056a327/0xcd11f61c1413e45a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.443248:0:8428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009056a327/0xcd11f61c1413e45a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.443257:0:8428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957800 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664327.443261:0:8428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009056a327/0xcd11f61c1413e45a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.443271:0:8428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009056a327/0xcd11f61c1413e45a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.443296:0:8428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009056a327/0xcd11f61c1413e45a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.443305:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009056a327/0xcd11f61c1413e45a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664327.443519:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119488000:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 8295us (8450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664327.443527:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:3.0:1788664327.456064:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664327.456094:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119488384 00000100:00100000:3.0:1788664327.456102:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119488384 00000100:00100000:3.0:1788664327.456153:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 201 00000100:00100000:3.0:1788664327.456161:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:12351:x1875550119488384:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788664327.456230:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e461 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.456246:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e2a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d7 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.456256:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e461 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.456292:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e2a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d7 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.456306:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e2a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d7 expref: 19 pid: 6512 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664327.456321:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140523904:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664327.456406:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3038a10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664327.466987:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664327.467015:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119488512 00000100:00100000:0.0:1788664327.467022:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119488512 00010000:00010000:0.0:1788664327.467071:0:10332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e2a8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d7 expref: 20 pid: 6512 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664327.467104:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:0.0:1788664327.467113:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:2391:x1875550119488512:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664327.467128:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664327.467134:0:10332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e2a8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d7 expref: 20 pid: 6512 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.467149:0:10332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e2a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d7 expref: 20 pid: 6512 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.467170:0:10332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:0.0:1788664327.467176:0:10332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e461 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.467194:0:10332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e461 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.467201:0:10332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e461 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.467220:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664327.467269:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:2391:x1875550119488512:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 157us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664327.467277:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00010000:00010000:1.0:1788664327.467718:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e2a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d4d7 expref: 19 pid: 6512 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664327.467734:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140523904:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664327.467754:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e461 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.467762:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e461 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.467768:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e461 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.468511:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e468 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.468527:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e429 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d539 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.468536:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e468 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.468569:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e429 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d539 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.468584:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e429 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d539 expref: 19 pid: 6513 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664327.468598:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140524032:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664327.468666:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c402f1a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664327.470988:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140524032:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664327.471014:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e468 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664327.480761:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664327.480817:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119488640 00000100:00100000:0.0:1788664327.480827:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119488640 00010000:00010000:0.0:1788664327.480865:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e429 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d539 expref: 20 pid: 6513 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664327.480902:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:0.0:1788664327.480911:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303740380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:2390:x1875550119488640:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664327.480927:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664327.480934:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e429 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d539 expref: 20 pid: 6513 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.480948:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e429 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d539 expref: 20 pid: 6513 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.480969:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e429 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d539 expref: 20 pid: 6513 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.481016:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93c4130a6000) 00010000:00010000:0.0:1788664327.481022:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e468 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.482126:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e468 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.482134:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e468 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.482164:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664327.482221:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303740380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:2390:x1875550119488640:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 1308us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664327.482231:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 91 00010000:00010000:3.0:1788664327.487691:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e468 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.487707:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e468 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788664327.487876:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1788664327.487998:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:3.0:1788664327.488356:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1788664327.488457:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1875550140524160:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788664327.488522:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664327.488561:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c411902a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664327.488620:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140524160 00000100:00100000:1.0:1788664327.488629:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140524160 00000100:00100000:1.0:1788664327.488738:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788664327.488748:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6511:x1875550140524160:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788664327.488843:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6511:x1875550140524160:12345-0@lo:1000:mdt00_000.0 Request processed in 96us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664327.488851:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788664327.488930:0:6511:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1788664327.488935:0:6511:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c3041b8a80, transno 4294967316 00000100:00100000:3.0:1788664327.488952:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1875550140524160:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788664327.489167:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:3.0:1788664327.489207:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1875550140524288:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788664327.489234:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664327.489251:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c418280d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664327.489265:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140524288 00000100:00100000:3.0:1788664327.489269:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140524288 00000100:00100000:3.0:1788664327.489455:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788664327.489463:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6511:x1875550140524288:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788664327.489592:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6511:x1875550140524288:12345-0@lo:1000:mdt00_000.0 Request processed in 130us (356us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788664327.489599:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788664327.490192:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1875550140524288:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788664327.490244:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e468 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490260:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e468 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490268:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e468 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490275:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664327.490280:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e468 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490359:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e468 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490376:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93c4130a6000) 00010000:00010000:1.0:1788664327.490379:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788664327.490385:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e468 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490391:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84600/0xcd11f61c1413e468 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490412:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e3a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490418:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e3a4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490434:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e3a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490439:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664327.490448:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e3a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490454:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e3a4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490464:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:1.0:1788664327.490466:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788664327.490469:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e3a4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490476:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e3a4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490498:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e46f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490513:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e3c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d51d expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490522:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e46f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490554:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d51d expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664327.490567:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e3c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d51d expref: 22 pid: 6513 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664327.490580:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140524416:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664327.490696:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c402f1a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788664327.500815:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664327.503238:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875550140524416:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788664327.503267:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e46f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664327.503485:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119488768 00000100:00100000:3.0:1788664327.503493:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119488768 00010000:00010000:3.0:1788664327.503552:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e3c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d51d expref: 23 pid: 6513 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664327.503628:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:3.0:1788664327.503640:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+23:2391:x1875550119488768:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664327.503656:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664327.503669:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e3c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d51d expref: 23 pid: 6513 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.503691:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d51d expref: 23 pid: 6513 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.503722:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e3c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d51d expref: 23 pid: 6513 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.503737:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:3.0:1788664327.503748:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e46f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.503759:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e46f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.503766:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e46f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664327.503841:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664327.503912:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:2391:x1875550119488768:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 273us (3103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664327.503920:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 92 00010000:00010000:2.0:1788664327.505013:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e46f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.505035:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e46f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.505049:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e46f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.505056:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e46f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.505063:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e46f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.505082:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664327.505087:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e46f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.505094:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e46f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.505107:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:2.0:1788664327.505110:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664327.505114:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e46f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.505120:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85000/0xcd11f61c1413e46f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.505132:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e461 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.505138:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e461 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.505143:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e461 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.505147:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664327.505150:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e461 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.505155:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e461 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.505172:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887900) 00010000:00010000:2.0:1788664327.505175:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788664327.505178:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e461 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.505183:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e461 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664327.505349:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:12351:x1875550119488384:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 49184us (49286us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788664327.505358:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 201 00000020:00080000:2.0:1788664327.505362:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788664327.505485:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664327.505489:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664327.506018:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788664327.506026:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788664327.508850:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664327.508977:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119489024 00000100:00100000:0.0:1788664327.508996:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119489024 00000100:00100000:0.0:1788664327.509055:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:0.0:1788664327.509065:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c406b61050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:12351:x1875550119489024:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788664327.509510:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788664327.509542:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:0.0:1788664327.509574:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e476 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.509589:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e476 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.509609:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e476 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.509618:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e476 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.509624:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e476 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.509630:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e476 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664327.509655:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788664327.509832:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c406b61050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+23:12351:x1875550119489024:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 767us (996us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788664327.509840:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000020:00080000:0.0:1788664327.509845:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788664327.512232:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664327.512246:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e476 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.512257:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957200 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:2.0:1788664327.512261:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e476 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.512269:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e476 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.512353:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93c4130a6000) 00010000:00010000:2.0:1788664327.512357:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788664327.512376:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e476 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.512383:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e476 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664327.512397:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664327.512399:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664327.512401:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664327.614252:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664327.743817:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140524544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664327.743902:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664327.744971:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140524544 00000100:00100000:3.0:1788664327.744990:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140524544 00000100:00100000:3.0:1788664327.745050:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788664327.745060:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c405319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875550140524544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788664327.745091:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788664327.745164:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c405319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875550140524544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664327.745171:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788664327.745484:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304277800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140524672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788664327.745525:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664327.746193:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140524672 00000100:00100000:2.0:1788664327.746211:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140524672 00000100:00100000:2.0:1788664327.746282:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788664327.746484:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140524672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788664327.746502:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788664327.746556:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140524672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664327.746563:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788664327.746611:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304277800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140524672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664327.746964:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140524544:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788664328.639057:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788664329.225744:0:14705:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788664329.225753:0:14705:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788664329.225799:0:14705:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788664329.225806:0:14705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788664329.390343:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664329.390374:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119489280 00000100:00100000:3.0:1788664329.390384:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119489280 00000100:00100000:3.0:1788664329.390462:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00100000:3.0:1788664329.390473:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+23:12370:x1875550119489280:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664329.390511:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664329.390530:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413e47d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d555 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.390628:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413e484 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.390643:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413e484 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.390656:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413e484 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788664329.390821:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1788664329.390871:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788664329.391749:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413e47d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d555 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.391825:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413e484 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d555 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.391836:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:3.0:1788664329.391839:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788664329.391843:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502b800, rc 0) 00000100:00100000:3.0:1788664329.392044:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:12370:x1875550119489280:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1571us (1709us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788664329.392053:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00100000:3.0:1788664329.407399:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664329.410016:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119489408 00000100:00100000:0.0:1788664329.410029:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119489408 00000100:00100000:0.0:1788664329.410088:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 203 00000100:00100000:0.0:1788664329.410098:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:12370:x1875550119489408:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:0.0:1788664329.410173:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e492 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410202:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e492 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410214:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e492 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410231:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e499 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410238:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e499 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410244:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e499 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410318:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e4a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410326:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410333:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664329.410521:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410535:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e492 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410542:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e492 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410560:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e492 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410566:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957a00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664329.410570:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e492 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410577:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e492 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410589:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:0.0:1788664329.410592:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664329.410596:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e492 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410602:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e492 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410613:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e499 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410618:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e499 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410623:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e499 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410628:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957e00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664329.410631:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e499 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410645:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e499 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410652:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c303887100) 00010000:00010000:0.0:1788664329.410654:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664329.410656:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e499 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410661:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e499 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410675:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410680:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e4a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410684:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410688:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664329.410691:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410695:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e4a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410701:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c303887000) 00010000:00010000:0.0:1788664329.410703:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664329.410705:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e4a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.410720:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e4a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664329.410814:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:12370:x1875550119489408:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 716us (3422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664329.410822:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 203 00000100:00100000:2.0:1788664329.469955:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664329.470058:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119489664 00000100:00100000:0.0:1788664329.470070:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119489664 00000100:00100000:2.0:1788664329.470190:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:2.0:1788664329.470201:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+25:12373:x1875550119489664:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664329.470223:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664329.470244:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e4a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d55c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470318:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e4ae lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470352:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e4ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470364:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e4ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470381:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e4b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470388:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470394:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470543:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e4bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470552:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470559:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664329.470569:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788664329.470641:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e4ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470648:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e4ae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470667:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e4ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470680:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ce00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664329.470684:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e4ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470692:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e4ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470703:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:2.0:1788664329.470706:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664329.470710:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e4ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470715:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e4ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470726:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470731:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e4b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470736:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470741:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664329.470743:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.470749:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e4b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.471179:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c4130a6200) 00010000:00010000:2.0:1788664329.471185:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664329.471189:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e4b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.471197:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e4b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.471247:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e4a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d55c expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.471261:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e4bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d55c expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.471269:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:2.0:1788664329.471272:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664329.471275:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c600, rc 0) 00000100:00100000:2.0:1788664329.471393:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+27:12373:x1875550119489664:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1194us (1446us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788664329.471401:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:0.0:1788664329.476263:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664329.476356:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119489792 00000100:00100000:2.0:1788664329.476366:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119489792 00000100:00100000:2.0:1788664329.476685:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:2.0:1788664329.476696:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+27:12373:x1875550119489792:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1788664329.476762:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e4ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.476811:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e4ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.476829:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e4ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.476864:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e4ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.476871:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e4ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.476878:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e4ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.476884:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664329.476888:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e4ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.476896:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e4ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.476908:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:2.0:1788664329.476911:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664329.476915:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e4ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.476921:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e4ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664329.476984:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+27:12373:x1875550119489792:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 290us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664329.476992:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:3.0:1788664329.480710:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664329.480992:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119490048 00000100:00100000:0.0:1788664329.481002:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119490048 00000100:00100000:0.0:1788664329.481062:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:0.0:1788664329.481073:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+27:12373:x1875550119490048:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788664329.481323:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+28:12373:x1875550119490048:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 251us (622us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1788664329.481331:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:3.0:1788664329.521186:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664329.521400:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119490304 00000100:00100000:0.0:1788664329.521418:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119490304 00000100:00100000:0.0:1788664329.521504:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:0.0:1788664329.521516:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+28:11897:x1875550119490304:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788664329.521542:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664329.521563:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e4d1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d563 expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.521675:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.521705:0:9169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e4bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d55c expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.521714:0:9169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.521745:0:9169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e4bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d55c expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.521759:0:9169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e4bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d55c expref: 29 pid: 6511 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664329.521806:0:9169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304833800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9169:1875550140524800:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788664329.521903:0:9169:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664329.525503:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664329.525658:0:9169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304833800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9169:1875550140524800:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788664329.525694:0:9169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664329.525906:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119490432 00000100:00100000:2.0:1788664329.525929:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119490432 00010000:00010000:2.0:1788664329.525965:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e4bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d55c expref: 30 pid: 6511 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664329.526110:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:2.0:1788664329.526119:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3041b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+30:2390:x1875550119490432:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664329.526135:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664329.526142:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e4bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d55c expref: 30 pid: 6511 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.526154:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e4bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d55c expref: 30 pid: 6511 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.526178:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e4bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d55c expref: 30 pid: 6511 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.526195:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:2.0:1788664329.526201:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.526212:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.526221:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.526253:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664329.526324:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3041b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+29:2390:x1875550119490432:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 205us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664329.526341:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 93 00010000:00010000:3.0:1788664329.527497:0:9169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.527510:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664329.527531:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788664329.527676:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956800/0xcd11f61c1413e4d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d563 expref: 30 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.527695:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d563 expref: 29 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.527714:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:3.0:1788664329.527717:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788664329.527720:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957e00, rc 0) 00000100:00100000:3.0:1788664329.527809:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+29:11897:x1875550119490304:12345-192.168.203.52@tcp:101:bash.0 Request processed in 6295us (6631us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788664329.527818:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:1.0:1788664329.531371:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664329.531447:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119490560 00000100:00100000:2.0:1788664329.531457:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119490560 00000100:00100000:2.0:1788664329.531517:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:2.0:1788664329.531528:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+29:11897:x1875550119490560:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788664329.531552:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664329.531573:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e4e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d56a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.531609:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e4ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.531623:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e4ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.531635:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e4ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.532535:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413e4e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d56a expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.532558:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e4ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d56a expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.532567:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:2.0:1788664329.532569:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788664329.532573:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400030a00, rc 0) 00000100:00100000:2.0:1788664329.532688:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+30:11897:x1875550119490560:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1161us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664329.532705:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:2.0:1788664329.539345:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664329.539426:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119490816 00000100:00100000:3.0:1788664329.539436:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119490816 00000100:00100000:3.0:1788664329.539492:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 208 00000100:00100000:3.0:1788664329.539502:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+30:11897:x1875550119490816:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:3.0:1788664329.540222:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413e4f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.540240:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413e4f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.540252:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413e4f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788664329.540295:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:3.0:1788664329.540320:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fb2f8f3 reply state 00000000084ae279 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413e4f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.540333:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413e4f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.540341:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:3.0:1788664329.540343:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788664329.540360:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788664329.540401:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:3.0:1788664329.540563:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+34:11897:x1875550119490816:12345-192.168.203.52@tcp:36:bash.0 Request processed in 1060us (1225us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788664329.540572:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 208 00000020:00080000:3.0:1788664329.540577:0:9524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788664329.542700:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664329.542805:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119490944 00000100:00100000:3.0:1788664329.542815:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119490944 00000100:00100000:3.0:1788664329.542870:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:3.0:1788664329.542879:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+34:11897:x1875550119490944:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788664329.542901:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664329.542922:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e4fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d571 expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.542973:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e4fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d571 expref: 35 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.542988:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e4fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d571 expref: 35 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.543006:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:3.0:1788664329.543009:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664329.543013:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502aa00, rc 0) 00000100:00100000:3.0:1788664329.543063:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+35:11897:x1875550119490944:12345-192.168.203.52@tcp:101:bash.0 Request processed in 185us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664329.543071:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:1.0:1788664329.545953:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664329.546344:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119491072 00000100:00100000:2.0:1788664329.546354:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119491072 00000100:00100000:2.0:1788664329.546478:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:2.0:1788664329.546488:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43ced9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:11897:x1875550119491072:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788664329.546507:0:9895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664329.546530:0:9895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413e502 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d578 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664329.546556:0:9895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9cda05, atime: 0x6a9cda03, ctime: 0x6a9cda05, blocks: 0x8 00010000:00010000:2.0:1788664329.546577:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=424s v=(0 0) 00010000:00010000:2.0:1788664329.546582:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664329.546591:0:9895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413e502 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d578 expref: 8 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.546611:0:9895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413e502 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d578 expref: 8 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.546623:0:9895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400030400, rc 0) 00000100:00100000:2.0:1788664329.546697:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43ced9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:11897:x1875550119491072:12345-192.168.203.52@tcp:101:bash.0 Request processed in 210us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664329.546704:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:3.0:1788664329.549366:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664329.549468:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119491200 00000100:00100000:0.0:1788664329.549477:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119491200 00002000:00010000:0.0:1788664329.549517:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788664329.549522:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c30480ca80 with x1875550119491200 ext(0->18446744073709551615) 00002000:00010000:0.0:1788664329.549533:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c30480ca80. 00000100:00100000:0.0:1788664329.549567:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1788664329.549578:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2391:x1875550119491200:12345-192.168.203.52@tcp:10:bash.0 00002000:00010000:0.0:1788664329.549881:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788664329.549895:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788664325 -> 1788664329 00002000:00010000:0.0:1788664329.549898:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788664323 -> 1788664323 00002000:00010000:0.0:1788664329.549900:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788664325 -> 1788664329 00002000:00010000:0.0:1788664329.549903:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788664329.549963:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2391:x1875550119491200:12345-192.168.203.52@tcp:10:bash.0 Request processed in 386us (604us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788664329.549971:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00002000:00010000:0.0:1788664329.549987:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788664329.549990:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c30480ca80 with x1875550119491200 ext(0->18446744073709551615) 00002000:00010000:0.0:1788664329.549995:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c30480ca80. 00000100:00080000:1.0:1788664329.550338:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664329.638163:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664329.638282:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119491328 00000100:00100000:2.0:1788664329.638292:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119491328 00000100:00100000:2.0:1788664329.638365:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:2.0:1788664329.638386:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+35:12387:x1875550119491328:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:2.0:1788664329.638469:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e509 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638486:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e509 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638498:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e509 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638514:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e510 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638521:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e510 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638528:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e510 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638600:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e517 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638608:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638615:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664329.638672:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638683:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e509 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638695:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e509 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638701:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e509 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638707:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664329.638712:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e509 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638719:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e509 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638730:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:2.0:1788664329.638733:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664329.638737:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e509 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638743:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e509 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638756:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e510 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638762:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e510 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638767:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e510 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638827:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664329.638836:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e510 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638842:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e510 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638850:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c4130a6c00) 00010000:00010000:2.0:1788664329.638853:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664329.638856:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e510 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638862:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e510 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638877:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638883:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e517 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638890:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e517 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638894:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ca00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664329.638897:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e517 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638903:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e517 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638910:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:2.0:1788664329.638912:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664329.638920:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e517 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.638927:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e517 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664329.639015:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+35:12387:x1875550119491328:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 639us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664329.639023:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 210 00010000:00010000:2.0:1788664329.665574:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664329.709916:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664329.710104:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119491584 00000100:00100000:3.0:1788664329.710126:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119491584 00000100:00100000:3.0:1788664329.710183:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:3.0:1788664329.710192:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+35:12390:x1875550119491584:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664329.710212:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664329.710232:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e51e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d57f expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710301:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e525 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710316:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e525 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710327:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e525 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710340:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e52c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710347:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e52c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710353:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e52c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710481:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e533 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710491:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e533 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710498:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e533 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664329.710514:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788664329.710584:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e525 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710591:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e525 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710598:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e525 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710610:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ac00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664329.710615:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e525 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710622:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e525 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710634:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:3.0:1788664329.710637:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664329.710641:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e525 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710647:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e525 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710668:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e52c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710674:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e52c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710688:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e52c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710694:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502be00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664329.710696:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e52c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710702:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e52c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710710:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c4350d6c00) 00010000:00010000:3.0:1788664329.710712:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664329.710715:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e52c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710720:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e52c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710760:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e51e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d57f expref: 38 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710818:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e533 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d57f expref: 37 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.710826:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:3.0:1788664329.710828:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788664329.710830:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502b400, rc 0) 00000100:00100000:3.0:1788664329.715961:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+37:12390:x1875550119491584:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 5757us (6190us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788664329.716200:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:1.0:1788664329.718555:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664329.718721:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119491712 00000100:00100000:0.0:1788664329.718731:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119491712 00000100:00100000:0.0:1788664329.718880:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:0.0:1788664329.718891:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+37:12390:x1875550119491712:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1788664329.718984:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e541 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.719002:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d563 expref: 37 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.719012:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e541 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.719047:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d563 expref: 37 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.719060:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d563 expref: 37 pid: 9169 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664329.719090:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304830a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875550140524928:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788664329.719180:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664329.722697:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664329.722748:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304830a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875550140524928:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664329.723132:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119491968 00010000:00010000:2.0:1788664329.723138:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e541 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664329.723141:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119491968 00000100:00100000:1.0:1788664329.723200:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:1.0:1788664329.723214:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+38:6161:x1875550119491968:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788664329.723531:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+39:6161:x1875550119491968:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 318us (843us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788664329.723539:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:3.0:1788664329.726720:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664329.731751:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119492096 00000100:00100000:1.0:1788664329.731766:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119492096 00010000:00010000:1.0:1788664329.731873:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d563 expref: 39 pid: 9169 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664329.731984:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:1.0:1788664329.731995:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+39:2390:x1875550119492096:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664329.732020:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664329.732028:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d563 expref: 39 pid: 9169 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664329.732062:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d563 expref: 39 pid: 9169 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664329.732105:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e4d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d563 expref: 39 pid: 9169 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664329.732124:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:1.0:1788664329.732131:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e541 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664329.732141:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664329.732150:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e541 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664329.732183:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664329.732247:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+38:2390:x1875550119492096:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 253us (5533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664329.732254:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 94 00010000:00010000:2.0:1788664329.734060:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.734077:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.734125:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.734134:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e541 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.734141:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e541 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.734147:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664329.734152:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e541 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.734181:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e541 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.734197:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:2.0:1788664329.734201:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664329.734205:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e541 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664329.734212:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e541 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664329.734344:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+37:12390:x1875550119491712:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 15450us (15791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664329.734353:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:3.0:1788664329.744384:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664329.744743:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119492352 00000100:00100000:1.0:1788664329.744754:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119492352 00000100:00100000:0.0:1788664329.745846:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:0.0:1788664329.745860:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+37:12390:x1875550119492352:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788664329.746189:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+38:12390:x1875550119492352:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 332us (1812us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788664329.746197:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000001:00080000:2.0:1788664329.792141:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1788664329.792158:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:0.0:1788664329.851416:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664329.851496:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119492608 00000100:00100000:3.0:1788664329.851515:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119492608 00000100:00100000:3.0:1788664329.851577:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:3.0:1788664329.851589:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+38:12401:x1875550119492608:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:3.0:1788664329.851616:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664329.851639:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413e548 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d586 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.851900:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e54f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.851927:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e54f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.851940:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e54f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.851956:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e556 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.851964:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e556 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.851971:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e556 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852083:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e55d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852108:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e55d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852115:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e55d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664329.852125:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788664329.852211:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e54f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852220:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e54f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852226:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e54f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852232:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502bc00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664329.852237:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e54f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852244:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e54f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852258:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:3.0:1788664329.852261:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664329.852266:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e54f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852272:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e54f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852285:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e556 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852305:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e556 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852311:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e556 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852316:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502be00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664329.852320:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e556 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852326:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e556 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852334:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c4350d6c00) 00010000:00010000:3.0:1788664329.852337:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664329.852340:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e556 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852345:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e556 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852391:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413e548 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d586 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852403:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e55d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d586 expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.852421:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:3.0:1788664329.852424:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664329.852432:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502ac00, rc 0) 00000100:00100000:3.0:1788664329.852511:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+40:12401:x1875550119492608:12345-192.168.203.52@tcp:101:cat.0 Request processed in 923us (1113us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788664329.852519:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:0.0:1788664329.861373:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664329.861461:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119492864 00000100:00100000:3.0:1788664329.861472:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119492864 00000100:00100000:3.0:1788664329.861544:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:3.0:1788664329.861554:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+40:12401:x1875550119492864:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:3.0:1788664329.861939:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+41:12401:x1875550119492864:12345-192.168.203.52@tcp:35:cat.0 Request processed in 385us (573us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788664329.861947:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:0.0:1788664329.899069:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664329.899153:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119493120 00000100:00100000:3.0:1788664329.899164:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119493120 00000100:00100000:3.0:1788664329.899229:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:3.0:1788664329.899240:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c412c9a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+41:12402:x1875550119493120:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:3.0:1788664329.899300:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788664329.899328:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e4fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d571 expref: 41 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.899353:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e55d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d586 expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.899366:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e533 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d57f expref: 39 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.899379:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e4ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d56a expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.899420:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:3.0:1788664329.899426:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664329.899449:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413e56b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.899461:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413e56b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.899470:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413e56b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.899494:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e572 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.899503:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e572 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.899510:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e572 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.899582:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e579 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.899590:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e579 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.899597:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e579 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788664329.899992:0:9524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788664329.900004:0:9524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 425037231908ns, next at 426037229418ns, rc = 0 00010000:00010000:3.0:1788664329.900062:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e580 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900072:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e580 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900080:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e580 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900087:0:9524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e580 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900094:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e580 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900102:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e580 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900128:0:9524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664329.900147:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e579 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900153:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e579 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900160:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e579 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900167:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502bc00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664329.900171:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e579 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900180:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e579 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900196:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:3.0:1788664329.900199:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788664329.900204:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e579 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900210:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e579 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664329.900220:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664329.900229:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413e56b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664329.900230:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e580 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900248:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413e56b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664329.900249:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b600 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664329.900257:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e580 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900259:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413e56b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900267:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ae00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664329.900272:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413e56b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900280:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413e56b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900289:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:1.0:1788664329.900290:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e580 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900293:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664329.900298:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413e56b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900306:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ae00/0xcd11f61c1413e56b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664329.900307:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:1.0:1788664329.900314:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788664329.900318:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e580 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664329.900334:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e580 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664329.900343:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056579ee4 reply state 0000000044079423 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e572 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664329.900348:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664329.900351:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664329.900355:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664329.900358:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e572 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.900366:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c4350d6c00) 00010000:00010000:3.0:1788664329.900368:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788664329.900370:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788664329.900460:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c412c9a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+39:12402:x1875550119493120:12345-192.168.203.52@tcp:36:rm.0 Request processed in 1219us (1399us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788664329.900467:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:2.0:1788664329.971813:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664329.971976:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119493376 00000100:00100000:0.0:1788664329.971986:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119493376 00000100:00100000:0.0:1788664329.972051:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:0.0:1788664329.972063:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+39:12408:x1875550119493376:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788664329.972091:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664329.972114:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e587 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d58d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.972219:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e58e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.972235:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e58e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.972248:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e58e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.972284:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e595 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.972292:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e595 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.972298:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e595 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788664329.972843:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788664329.973172:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e59c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.973185:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e59c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.973194:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e59c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.973228:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e58e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.973237:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e58e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.973244:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e58e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.973250:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664329.973255:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e58e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.973375:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e58e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.973390:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:0.0:1788664329.973394:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664329.973399:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e58e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.973415:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e58e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664329.973431:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077729594 reply state 00000000d078730e transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e595 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.973442:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e595 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.973448:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c4350d6c00) 00010000:00010000:0.0:1788664329.973451:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788664329.973455:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788664329.973557:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e587 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d58d expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.973572:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e59c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d58d expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664329.973580:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c303887000) 00010000:00010000:0.0:1788664329.973582:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664329.973584:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956400, rc 0) 00000100:00100000:0.0:1788664329.973739:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+42:12408:x1875550119493376:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1677us (1973us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788664329.973754:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:1.0:1788664329.998560:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664329.998635:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119493504 00000100:00100000:3.0:1788664329.998644:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119493504 00000100:00100000:3.0:1788664329.998721:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:3.0:1788664329.998732:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119493504:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788664329.998751:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664329.998805:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004667bdb3/0xcd11f61c1413e5aa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d594 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788664329.998853:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788664329.998869:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1788664329.998873:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664329.998882:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004667bdb3/0xcd11f61c1413e5aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d594 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.998899:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004667bdb3/0xcd11f61c1413e5aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d594 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664329.998924:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502ae00, rc 0) 00000100:00100000:3.0:1788664329.998973:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2390:x1875550119493504:12345-192.168.203.52@tcp:101:bash.0 Request processed in 243us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664329.998980:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00080000:1.0:1788664329.999133:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664330.010765:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664330.011071:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119493632 00000100:00100000:2.0:1788664330.011081:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119493632 00000100:00100000:2.0:1788664330.011138:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:2.0:1788664330.011148:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:12408:x1875550119493632:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788664330.011166:0:9895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664330.011182:0:9895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d59b expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.011213:0:9895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004667bdb3/0xcd11f61c1413e5aa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d594 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.011239:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664330.011244:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664330.011250:0:9895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 7 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.011283:0:9895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004667bdb3/0xcd11f61c1413e5aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d594 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.011297:0:9895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004667bdb3/0xcd11f61c1413e5aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d594 expref: 7 pid: 8429 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664330.011313:0:9895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304275f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9895:1875550140525056:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664330.011418:0:9895:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303406540 going to sleep for 11 seconds 00000100:00100000:1.0:1788664330.014691:0:9895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304275f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9895:1875550140525056:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664330.014728:0:9895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 7 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.014750:0:9895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0ce00, rc 0) 00000100:00100000:1.0:1788664330.014848:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:12408:x1875550119493632:12345-192.168.203.52@tcp:101:bash.0 Request processed in 3700us (4091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664330.014857:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:2.0:1788664330.015803:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664330.015975:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119493760 00000100:00100000:1.0:1788664330.015985:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119493760 00010000:00010000:1.0:1788664330.016021:0:10332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004667bdb3/0xcd11f61c1413e5aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d594 expref: 7 pid: 8429 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664330.016077:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:1.0:1788664330.016088:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047b2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119493760:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664330.016103:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664330.016125:0:10332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004667bdb3/0xcd11f61c1413e5aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d594 expref: 7 pid: 8429 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.016138:0:10332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004667bdb3/0xcd11f61c1413e5aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d594 expref: 7 pid: 8429 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.016163:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004667bdb3/0xcd11f61c1413e5aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d594 expref: 7 pid: 8429 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.016178:0:10332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664330.016182:0:10332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664330.016191:0:10332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 6 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.016201:0:10332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 6 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.016237:0:10332:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 6 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664330.016250:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10332:1875550140525184:192.168.203.52@tcp:105: 00000100:00100000:1.0:1788664330.016319:0:10332:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c402f1a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788664330.029132:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664330.029209:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119494016 00000100:00100000:3.0:1788664330.029217:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119494016 00000100:00100000:3.0:1788664330.029271:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:3.0:1788664330.029281:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+42:12408:x1875550119494016:12345-192.168.203.52@tcp:35:bash.0 00000001:00080000:3.0:1788664330.029519:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000100:00100000:3.0:1788664330.029639:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+44:12408:x1875550119494016:12345-192.168.203.52@tcp:35:bash.0 Request processed in 358us (516us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1788664330.029647:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000020:00080000:3.0:1788664330.029651:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788664330.030324:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10332:1875550140525184:192.168.203.52@tcp:105: 00010000:00010000:1.0:1788664330.030347:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664330.030435:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047b2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2391:x1875550119493760:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 14348us (14636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664330.030443:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:0.0:1788664330.197046:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664330.197137:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119494144 00000100:00100000:3.0:1788664330.197146:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119494144 00000100:00100000:3.0:1788664330.197206:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 216 00000100:00100000:3.0:1788664330.197216:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+44:12424:x1875550119494144:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664330.197241:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664330.197262:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e5b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d5a2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.197348:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e5bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.197381:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e5bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.197392:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e5bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664330.197444:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788664330.197448:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788664330.197466:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e5bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.197503:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e5b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5a2 expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.197521:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e5bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5a2 expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.197529:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:3.0:1788664330.197532:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788664330.197536:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502b400, rc 0) 00000100:00100000:3.0:1788664330.197618:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+45:12424:x1875550119494144:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 404us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664330.197630:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 216 00000100:00100000:0.0:1788664330.204719:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664330.204806:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119494400 00000100:00100000:3.0:1788664330.204816:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119494400 00000100:00100000:3.0:1788664330.204875:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00100000:3.0:1788664330.204884:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+45:12424:x1875550119494400:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664330.204903:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664330.204935:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e5c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d5a9 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.205035:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e5cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.205050:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e5cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.205061:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e5cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664330.205072:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788664330.205175:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e5c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5a9 expref: 48 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.205193:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e5cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5a9 expref: 47 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.205201:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c303887000) 00010000:00010000:3.0:1788664330.205204:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664330.205208:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502ac00, rc 0) 00000100:00100000:3.0:1788664330.205427:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+47:12424:x1875550119494400:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 542us (719us total) trans 4294967488 rc 0/0 00000100:00100000:3.0:1788664330.205435:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00100000:0.0:1788664330.213163:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664330.213587:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119494656 00000100:00100000:2.0:1788664330.213598:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119494656 00000100:00100000:2.0:1788664330.213657:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 218 00000100:00100000:2.0:1788664330.213666:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+47:12424:x1875550119494656:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664330.213701:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664330.213721:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e5db lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d5b0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.213845:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e5e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.213876:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e5e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.213886:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e5e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664330.213899:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788664330.215005:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e5db lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5b0 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.215030:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e5e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5b0 expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.215040:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c303887000) 00010000:00010000:2.0:1788664330.215042:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788664330.215046:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c600, rc 0) 00000100:00100000:2.0:1788664330.215127:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+49:12424:x1875550119494656:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1461us (1972us total) trans 4294967489 rc 0/0 00000100:00100000:2.0:1788664330.215135:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 218 00000100:00100000:0.0:1788664330.216043:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664330.216203:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119494784 00000100:00100000:2.0:1788664330.216212:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119494784 00000100:00100000:2.0:1788664330.216274:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788664330.216284:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304831880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+49:2392:x1875550119494784:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664330.216297:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664330.216317:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e5cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5a9 expref: 49 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.216349:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c303887000) 00010000:00010000:2.0:1788664330.216354:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664330.216395:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304831880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+48:2392:x1875550119494784:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 113us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664330.216402:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1788664330.228895:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664330.228986:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119494912 00000100:00100000:3.0:1788664330.228996:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119494912 00000100:00100000:3.0:1788664330.229051:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:3.0:1788664330.229061:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+6:2390:x1875550119494912:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:3.0:1788664330.229121:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4001ffb/0xcd11f61c1413e5f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.229306:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 6 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.229316:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664330.229320:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664330.229325:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4001ffb/0xcd11f61c1413e5f0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.229361:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 6 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.229374:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 6 pid: 9895 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664330.229389:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1875550140525312:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664330.229729:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3010866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664330.236192:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664330.236640:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1875550140525312:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664330.236716:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119495040 00000100:00100000:2.0:1788664330.236724:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119495040 00010000:00010000:3.0:1788664330.236738:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e4001ffb/0xcd11f61c1413e5f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1788664330.236797:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff93c304832680 x1875550119495040/t0(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:636/0 lens 504/0 e 0 to 0 dl 1788664341 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664330.236807:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c304832680 with x1875550119495040 ext(0->8) 00010000:00010000:2.0:1788664330.236814:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 7 pid: 9895 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.236829:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 7 pid: 9895 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664330.236837:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c304832680 00000100:00100000:2.0:1788664330.236860:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788664330.236869:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119495040:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:2.0:1788664330.238965:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2391:x1875550119495040:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 2089us (2773us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788664330.239385:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00002000:00100000:2.0:1788664330.239400:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff93c304832680 x1875550119495040/t4294967309(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:636/0 lens 504/448 e 0 to 0 dl 1788664341 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664330.239439:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c304832680 with x1875550119495040 ext(0->8) 00010000:00010000:2.0:1788664330.239449:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 9 pid: 9895 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.239465:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 9 pid: 9895 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664330.239472:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c304832680 00000100:00100000:0.0:1788664330.244813:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664330.244918:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119495168 00000100:00100000:1.0:1788664330.244928:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119495168 00010000:00010000:1.0:1788664330.245037:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 9 pid: 9895 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664330.245092:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:1.0:1788664330.245103:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304831f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2390:x1875550119495168:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664330.245122:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788664330.245141:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788664330.245144:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788664330 00002000:00010000:1.0:1788664330.245147:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788664330 00002000:00010000:1.0:1788664330.245149:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788664330 00002000:00010000:1.0:1788664330.245152:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788664330.245158:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 9 pid: 9895 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.245172:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 9 pid: 9895 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.245195:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db73d86b/0xcd11f61c1413e5b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d59b expref: 9 pid: 9895 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.245227:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664330.245231:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664330.245237:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4001ffb/0xcd11f61c1413e5f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.245246:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4001ffb/0xcd11f61c1413e5f0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.245279:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664330.245335:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304831f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2390:x1875550119495168:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 232us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664330.245342:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 96 00010000:00010000:3.0:1788664330.245360:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e4001ffb/0xcd11f61c1413e5f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.245382:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4001ffb/0xcd11f61c1413e5f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.245413:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4001ffb/0xcd11f61c1413e5f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.245422:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4001ffb/0xcd11f61c1413e5f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.245429:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4001ffb/0xcd11f61c1413e5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.245437:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502bc00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664330.245441:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4001ffb/0xcd11f61c1413e5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.245448:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4001ffb/0xcd11f61c1413e5f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.245460:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4001ffb/0xcd11f61c1413e5f0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.245467:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4001ffb/0xcd11f61c1413e5f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664330.245532:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2390:x1875550119494912:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 16473us (16646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664330.245544:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:0.0:1788664330.248873:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664330.249545:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119495424 00000100:00100000:3.0:1788664330.249556:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119495424 00000100:00100000:3.0:1788664330.249606:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:3.0:1788664330.249616:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c406b63c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+48:12424:x1875550119495424:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:3.0:1788664330.249692:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e5e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5b0 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788664330.249900:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1788664330.249937:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1788664330.250233:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1788664330.250274:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e5f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.250290:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e59c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d58d expref: 52 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.250299:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e5f7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.250330:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e59c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d58d expref: 52 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.250346:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e59c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d58d expref: 52 pid: 6513 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664330.250379:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6514:1875550140525440:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664330.250482:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664330.257589:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6514:1875550140525440:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664330.257625:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e5f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664330.258165:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664330.258237:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119495552 00000100:00100000:1.0:1788664330.258245:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119495552 00010000:00010000:1.0:1788664330.258283:0:10332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e59c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d58d expref: 53 pid: 6513 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664330.258331:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:1.0:1788664330.258341:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304831180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+53:2391:x1875550119495552:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664330.258359:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664330.258365:0:10332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e59c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d58d expref: 53 pid: 6513 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.258377:0:10332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e59c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d58d expref: 53 pid: 6513 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.258435:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956400/0xcd11f61c1413e59c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d58d expref: 53 pid: 6513 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.258451:0:10332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c303887000) 00010000:00010000:1.0:1788664330.258457:0:10332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e5f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.258466:0:10332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e5f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.258474:0:10332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e5f7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.258493:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664330.258499:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e5f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.258507:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e5f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664330.258548:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304831180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+52:2391:x1875550119495552:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 209us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664330.258556:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 97 00000001:00080000:2.0:1788664330.258636:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000001:00080000:2.0:1788664330.258766:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:2.0:1788664330.258884:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304277100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875550140525568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788664330.258943:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664330.258974:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303406540 going to sleep for 11 seconds 00000100:00100000:1.0:1788664330.259065:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140525568 00000100:00100000:1.0:1788664330.259071:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140525568 00000100:00100000:1.0:1788664330.259129:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788664330.259138:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1875550140525568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788664330.259210:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1875550140525568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664330.259217:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788664330.259279:0:6514:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1788664330.259285:0:6514:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1788664330.259317:0:6514:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c304364380, transno 4294967308 00000100:00100000:2.0:1788664330.259338:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304277100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875550140525568:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788664330.259445:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00000100:00100000:2.0:1788664330.259486:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304277100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875550140525696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788664330.259513:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664330.259543:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3034066c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664330.259557:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140525696 00000100:00100000:2.0:1788664330.259561:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140525696 00000100:00100000:2.0:1788664330.259586:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788664330.259594:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1875550140525696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788664330.259703:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6514:x1875550140525696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 109us (188us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788664330.259709:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788664330.259739:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304277100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875550140525696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788664330.259792:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:2.0:1788664330.259826:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e5f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.259836:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e5f7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.259842:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e5f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.259849:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502aa00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664330.259853:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e5f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.259861:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e5f7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788664330.259866:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788664330.259873:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c303887000) 00010000:00010000:2.0:1788664330.259876:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788664330.259880:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e5f7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.259896:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e5f7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788664330.259980:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788664330.260037:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788664330.260049:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 425397277698ns, next at 426397275724ns, rc = 0 00000001:00080000:2.0:1788664330.260058:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967497 00010000:00010000:2.0:1788664330.260080:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c303887000) 00010000:00010000:2.0:1788664330.260083:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788664330.260089:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e5e2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5b0 expref: 56 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664330.260176:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c406b63c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+55:12424:x1875550119495424:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 10561us (11312us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788664330.260184:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000020:00080000:2.0:1788664330.260188:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788664330.263291:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664330.264080:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119495680 00000100:00100000:2.0:1788664330.264092:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119495680 00000100:00100000:2.0:1788664330.264195:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 219 00000100:00100000:2.0:1788664330.264205:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+55:12424:x1875550119495680:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664330.264229:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664330.264250:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e5fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d5b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.264306:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e5fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5b7 expref: 56 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.264338:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e5fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5b7 expref: 56 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.264356:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:2.0:1788664330.264358:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788664330.264361:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c400, rc 0) 00000100:00100000:2.0:1788664330.264429:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+56:12424:x1875550119495680:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 226us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664330.264437:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 219 00000100:00100000:3.0:1788664330.271054:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664330.271142:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119495936 00000100:00100000:0.0:1788664330.271152:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119495936 00000100:00100000:0.0:1788664330.271213:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:0.0:1788664330.271226:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+56:12424:x1875550119495936:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788664330.271476:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+57:12424:x1875550119495936:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 254us (431us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1788664330.271484:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:0.0:1788664330.366619:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664330.366753:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119496064 00000100:00100000:3.0:1788664330.366762:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119496064 00000100:00100000:3.0:1788664330.366860:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 220 00000100:00100000:3.0:1788664330.366871:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+57:12434:x1875550119496064:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:3.0:1788664330.366957:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e605 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.366984:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e605 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.366996:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e605 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367009:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e60c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367016:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e60c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367021:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e60c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367107:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e613 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367118:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e613 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367126:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e613 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664330.367172:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e613 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367183:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e605 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367189:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e605 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367195:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e605 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367201:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502bc00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664330.367205:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e605 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367212:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e605 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367224:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:3.0:1788664330.367226:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664330.367231:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e605 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367246:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e605 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367258:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e60c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367264:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e60c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367270:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e60c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367274:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664330.367277:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e60c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367283:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e60c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367290:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c4350d6c00) 00010000:00010000:3.0:1788664330.367293:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664330.367295:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e60c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367301:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e60c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367309:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e613 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367315:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e613 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367327:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e613 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367332:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664330.367334:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e613 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367339:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e613 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367346:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:3.0:1788664330.367348:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664330.367351:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e613 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.367356:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e613 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664330.367498:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+57:12434:x1875550119496064:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 627us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664330.367506:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 220 00000100:00100000:1.0:1788664330.427729:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664330.427895:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119496320 00000100:00100000:3.0:1788664330.427906:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119496320 00000100:00100000:3.0:1788664330.427981:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 221 00000100:00100000:3.0:1788664330.427991:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+57:12437:x1875550119496320:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664330.428013:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664330.428034:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e61a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d5be expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428128:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e621 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428145:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e621 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428156:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e621 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428169:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e628 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428176:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428193:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428316:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e62f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428325:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e62f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428332:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e62f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664330.428341:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788664330.428427:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e621 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428435:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e621 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428447:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e621 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428452:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664330.428456:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e621 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428464:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e621 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428477:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:3.0:1788664330.428480:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664330.428484:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e621 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428503:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e621 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428518:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428524:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e628 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428529:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e628 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428534:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502bc00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664330.428537:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e628 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428553:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e628 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428561:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c4350d6c00) 00010000:00010000:3.0:1788664330.428563:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664330.428567:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e628 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428572:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e628 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428607:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e61a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5be expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428621:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e62f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5be expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.428628:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:3.0:1788664330.428630:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664330.428633:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502aa00, rc 0) 00000100:00100000:3.0:1788664330.428937:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:12437:x1875550119496320:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 946us (1214us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788664330.428946:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 221 00000100:00100000:1.0:1788664330.437658:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664330.437949:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119496448 00000100:00100000:2.0:1788664330.438064:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119496448 00000100:00100000:2.0:1788664330.438127:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 222 00000100:00100000:2.0:1788664330.438150:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:12437:x1875550119496448:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1788664330.438223:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e63d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.438477:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e63d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.438492:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e63d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.438534:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e63d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.438541:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e63d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.438630:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e63d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.438639:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664330.438643:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e63d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.438651:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e63d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.438668:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:2.0:1788664330.438671:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664330.438749:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e63d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.438757:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e63d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664330.438885:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:12437:x1875550119496448:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 747us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664330.438894:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 222 00000100:00100000:2.0:1788664330.443330:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664330.445373:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119496704 00000100:00100000:0.0:1788664330.445390:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119496704 00000100:00100000:0.0:1788664330.445468:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:0.0:1788664330.445481:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+59:12437:x1875550119496704:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788664330.447493:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+60:12437:x1875550119496704:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 2005us (4165us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788664330.447521:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1788664330.590234:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664330.590374:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119496960 00000100:00100000:2.0:1788664330.590391:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119496960 00000100:00100000:2.0:1788664330.590486:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 223 00000100:00100000:2.0:1788664330.590508:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+60:12447:x1875550119496960:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788664330.590535:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664330.590538:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788664330.590566:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b400/0xcd11f61c1413e5bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5a2 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.590602:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:2.0:1788664330.590608:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664330.590628:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e644 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d5c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.590738:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e64b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.590753:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e64b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.590763:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e64b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664330.590828:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788664330.590946:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e644 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5c5 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.591029:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e64b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5c5 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.591038:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:2.0:1788664330.591042:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664330.591045:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0ce00, rc 0) 00000100:00100000:2.0:1788664330.591196:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:12447:x1875550119496960:12345-192.168.203.52@tcp:101:bash.0 Request processed in 689us (977us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788664330.591204:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 223 00000100:00100000:1.0:1788664330.603493:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664330.605161:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664330.606080:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119497088 00000100:00100000:3.0:1788664330.606172:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119497088 00000100:00100000:3.0:1788664330.606269:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:3.0:1788664330.606284:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:12447:x1875550119497088:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788664330.606346:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664330.606376:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e659 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d5cc expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.606439:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e660 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.606459:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e660 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.606475:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e660 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.606749:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e659 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5cc expref: 63 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.606817:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e660 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5cc expref: 62 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664330.606829:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:3.0:1788664330.606833:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788664330.606838:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502bc00, rc 0) 00000100:00100000:3.0:1788664330.606993:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+62:12447:x1875550119497088:12345-192.168.203.52@tcp:101:bash.0 Request processed in 711us (3515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664330.607001:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:2.0:1788664330.609714:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119497216 00000100:00100000:2.0:1788664330.609733:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119497216 00000100:00100000:2.0:1788664330.609830:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:2.0:1788664330.609842:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+62:2390:x1875550119497216:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664330.609860:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664330.609886:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e64b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5c5 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.609909:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:2.0:1788664330.609914:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664330.611087:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:2390:x1875550119497216:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 1240us (5929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664330.611100:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788664330.613468:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664330.614061:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119497472 00000100:00100000:2.0:1788664330.614076:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119497472 00000100:00100000:2.0:1788664330.614137:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 225 00000100:00100000:2.0:1788664330.614148:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+61:12447:x1875550119497472:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:2.0:1788664330.614201:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664330.614229:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502aa00/0xcd11f61c1413e62f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5be expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.614249:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:2.0:1788664330.614255:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664330.614607:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e667 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.614622:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e667 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.614646:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e667 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664330.614689:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967503 00000004:00010000:2.0:1788664330.614713:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045cf3a86 reply state 0000000062978d8d transno 4294967504 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e667 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.614725:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e667 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.614731:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:2.0:1788664330.614734:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788664330.614736:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788664330.614867:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+63:12447:x1875550119497472:12345-192.168.203.52@tcp:36:bash.0 Request processed in 720us (1503us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788664330.614875:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 225 00000020:00080000:2.0:1788664330.614879:0:9524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788664330.618895:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664330.619631:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119497600 00000100:00100000:0.0:1788664330.619649:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119497600 00000100:00100000:0.0:1788664330.619928:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 226 00000100:00100000:0.0:1788664330.619939:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+63:12447:x1875550119497600:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788664330.619966:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664330.619989:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e66e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d5d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.620085:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e675 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.620102:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e675 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.620115:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e675 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664330.620145:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788664330.620150:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788664330.620172:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e675 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.620200:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e66e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5d3 expref: 65 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.620220:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e675 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5d3 expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.620261:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:0.0:1788664330.620265:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664330.620268:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956600, rc 0) 00000100:00100000:0.0:1788664330.620344:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+64:12447:x1875550119497600:12345-192.168.203.52@tcp:101:bash.0 Request processed in 407us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664330.620353:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 226 00000100:00100000:3.0:1788664330.624240:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664330.625637:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119497856 00000100:00100000:0.0:1788664330.625659:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119497856 00000100:00100000:0.0:1788664330.625762:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1788664330.625794:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+64:12447:x1875550119497856:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:0.0:1788664330.626248:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+65:12447:x1875550119497856:12345-192.168.203.52@tcp:35:bash.0 Request processed in 476us (2022us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788664330.626256:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00010000:00010000:3.0:1788664330.686058:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664330.692571:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664330.692710:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119497984 00000100:00100000:1.0:1788664330.692728:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119497984 00000100:00100000:1.0:1788664330.692848:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 227 00000100:00100000:1.0:1788664330.692860:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+65:12453:x1875550119497984:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788664330.692884:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664330.692907:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e67c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d5da expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.692972:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e683 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.692987:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.692998:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664330.693043:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788664330.693046:0:9169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664330.693064:0:9169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.693086:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e67c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5da expref: 67 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.693106:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e683 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5da expref: 66 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.693134:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:1.0:1788664330.693137:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788664330.693141:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85200, rc 0) 00000100:00100000:1.0:1788664330.693215:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+66:12453:x1875550119497984:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 357us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664330.693222:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 227 00000100:00100000:2.0:1788664330.703488:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664330.703585:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119498112 00000100:00100000:0.0:1788664330.703602:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119498112 00000100:00100000:0.0:1788664330.703687:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 228 00000100:00100000:0.0:1788664330.703703:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+66:12453:x1875550119498112:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664330.703734:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664330.703764:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e68a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d5e1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704079:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e691 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704099:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e691 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704133:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e691 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704148:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e698 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704155:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704162:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704253:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e69f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704263:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e69f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704271:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e69f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664330.704337:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788664330.704343:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788664330.704367:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e69f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704382:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e69f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704392:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e691 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704418:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e691 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704426:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e691 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704432:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664330.704437:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e691 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704445:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e691 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704460:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:0.0:1788664330.704463:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664330.704468:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e691 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704475:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e691 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704490:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704495:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e698 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704500:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e698 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704505:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664330.704515:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e698 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704522:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e698 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704530:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c4350d6c00) 00010000:00010000:0.0:1788664330.704532:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664330.704535:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e698 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704542:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957600/0xcd11f61c1413e698 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704575:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957000/0xcd11f61c1413e68a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e1 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704589:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e69f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e1 expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.704596:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:0.0:1788664330.704599:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664330.704602:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957200, rc 0) 00000100:00100000:0.0:1788664330.704685:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+67:12453:x1875550119498112:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 988us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664330.704694:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 228 00000100:00100000:3.0:1788664330.709506:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664330.709661:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119498368 00000100:00100000:2.0:1788664330.709675:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119498368 00000100:00100000:2.0:1788664330.709757:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 229 00000100:00100000:2.0:1788664330.709813:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+67:12453:x1875550119498368:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664330.709846:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664330.709875:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e6a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d5e8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.710104:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.710147:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e675 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5d3 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.710155:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e69f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e1 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.710164:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.710207:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e69f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e1 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.710222:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e69f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e1 expref: 68 pid: 6513 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664330.710239:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304274000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875550140525824:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788664330.710360:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e675 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5d3 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.710370:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e675 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5d3 expref: 68 pid: 6513 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664330.710379:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304274700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875550140525952:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664330.710416:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c401370780 going to sleep for 11 seconds 00000100:00100000:2.0:1788664330.716295:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304274000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875550140525824:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664330.719237:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664330.719931:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119498496 00000100:00100000:1.0:1788664330.719946:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119498496 00010000:00010000:1.0:1788664330.720001:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e69f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e1 expref: 69 pid: 6513 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664330.720057:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:1.0:1788664330.720068:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+69:2391:x1875550119498496:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664330.720089:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664330.720097:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e69f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e1 expref: 69 pid: 6513 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.720112:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e69f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e1 expref: 69 pid: 6513 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.720140:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e69f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e1 expref: 69 pid: 6513 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.720161:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:1.0:1788664330.720167:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.720197:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664330.720206:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664330.720281:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+68:2391:x1875550119498496:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 213us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664330.720290:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:2.0:1788664330.723175:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304274700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875550140525952:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788664330.723247:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664330.725254:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664330.725697:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119498624 00000100:00100000:1.0:1788664330.725711:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119498624 00010000:00010000:1.0:1788664330.725767:0:10332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e675 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5d3 expref: 68 pid: 6513 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664330.726210:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:0.0:1788664330.726225:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+68:2391:x1875550119498624:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664330.726247:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664330.726271:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e675 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5d3 expref: 68 pid: 6513 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.726286:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e675 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5d3 expref: 68 pid: 6513 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.726312:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e675 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5d3 expref: 68 pid: 6513 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.726332:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:0.0:1788664330.726338:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.726351:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.726360:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.726444:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664330.726523:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+67:2391:x1875550119498624:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 302us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664330.726536:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 99 00010000:00010000:2.0:1788664330.726539:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.726547:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664330.726573:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788664330.726753:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e6a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e8 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.726810:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e8 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.726819:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:2.0:1788664330.726822:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788664330.726824:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0ce00, rc 0) 00000100:00100000:2.0:1788664330.726856:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+67:12453:x1875550119498368:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 17090us (17366us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788664330.726865:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 229 00000100:00100000:3.0:1788664330.734193:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664330.734343:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119498880 00000100:00100000:2.0:1788664330.734357:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119498880 00000100:00100000:2.0:1788664330.734610:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1788664330.734625:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+67:12453:x1875550119498880:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:2.0:1788664330.734649:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664330.734687:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e5fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5b7 expref: 67 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.734733:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:2.0:1788664330.734750:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664330.735602:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+66:12453:x1875550119498880:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 973us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664330.735615:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788664330.739342:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664330.739458:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119499008 00000100:00100000:2.0:1788664330.739472:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119499008 00000100:00100000:2.0:1788664330.739544:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 230 00000100:00100000:2.0:1788664330.739557:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+66:12453:x1875550119499008:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:2.0:1788664330.739730:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e6bb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.739752:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e6bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664330.739767:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e6bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788664330.740149:0:9524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788664330.740256:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+66:12453:x1875550119499008:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 701us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664330.740265:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 230 00000100:00100000:3.0:1788664330.743562:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664330.744115:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119499136 00000100:00100000:0.0:1788664330.744130:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119499136 00000100:00100000:0.0:1788664330.744205:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 231 00000100:00100000:0.0:1788664330.744216:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+66:12453:x1875550119499136:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664330.744244:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664330.744269:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e6c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d5ef expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.744366:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e6bb lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.744700:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e6c2 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5ef expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.744730:0:6513:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e6bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.744747:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e6c2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5ef expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.744765:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:0.0:1788664330.744809:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664330.744816:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e6c2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5ef expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664330.744826:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956600, rc 0) 00000100:00100000:0.0:1788664330.744917:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+67:12453:x1875550119499136:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 703us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664330.744926:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 231 00000100:00100000:1.0:1788664330.816933:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140526080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664330.817047:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664330.817477:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140526080 00000100:00100000:3.0:1788664330.817489:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140526080 00000100:00100000:3.0:1788664330.817551:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788664330.817561:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140526080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664330.817605:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788664330.817688:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140526080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664330.817696:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788664330.817937:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140526080:0@lo:41:osp-pre-1-0.0 00000004:00080000:1.0:1788664331.326963:0:9900:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 426464185893ns, next at 427464180008ns, rc = 0 00000100:00100000:2.0:1788664331.327363:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140526208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664331.327500:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664331.327743:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140526208 00000100:00100000:1.0:1788664331.327755:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140526208 00000100:00100000:1.0:1788664331.327876:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788664331.327890:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875550140526208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664331.327935:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788664331.328008:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875550140526208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664331.328017:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788664331.329304:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140526336:0@lo:400:kworker.0 00000100:00100000:0.0:1788664331.329394:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664331.329455:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140526336 00000100:00100000:0.0:1788664331.329457:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140526848:0@lo:400:kworker.0 00000100:00100000:1.0:1788664331.329464:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140526336 00000100:00100000:0.0:1788664331.329486:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664331.329506:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140527360:0@lo:400:kworker.0 00000100:00100000:1.0:1788664331.329514:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788664331.329524:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140526336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664331.329552:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664331.329694:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140526592:0@lo:400:kworker.0 00000100:00100000:0.0:1788664331.329849:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788664331.329856:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140526464:0@lo:400:kworker.0 00000100:00100000:2.0:1788664331.329889:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140526720:0@lo:400:kworker.0 00000100:00100000:1.0:1788664331.336717:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3638:x1875550140526336:12345-0@lo:400:kworker.0 Request processed in 7178us (7306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664331.336737:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788664331.336885:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140526848 00000100:00100000:1.0:1788664331.336899:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140526848 00000100:00100000:1.0:1788664331.336975:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788664331.336985:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140526848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664331.337061:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140526848:12345-0@lo:400:kworker.0 Request processed in 78us (7574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664331.337068:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788664331.337101:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140527360 00000100:00100000:1.0:1788664331.337120:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140527360 00000100:00100000:1.0:1788664331.337154:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788664331.337160:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875550140527360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664331.337194:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875550140527360:12345-0@lo:400:kworker.0 Request processed in 35us (7641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664331.337200:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1788664331.337261:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664331.338733:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664331.338816:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140527104:0@lo:400:kworker.0 00000100:00100000:3.0:1788664331.338858:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664331.338889:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140527616:0@lo:400:kworker.0 00000100:00100000:3.0:1788664331.338911:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664331.338977:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140527104 00000100:00100000:3.0:1788664331.338986:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140527104 00000100:00100000:3.0:1788664331.339047:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140527616 00000100:00100000:3.0:1788664331.339051:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140527616 00000100:00100000:3.0:1788664331.339076:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788664331.339084:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140527104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664331.339101:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140526592 00000100:00100000:3.0:1788664331.339166:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140527104:12345-0@lo:400:kworker.0 Request processed in 82us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664331.339175:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788664331.339194:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788664331.339194:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140526592 00000100:00100000:3.0:1788664331.339201:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140527616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664331.339229:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788664331.339230:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140527616:12345-0@lo:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664331.339235:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788664331.339236:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42d9b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140526592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664331.339273:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42d9b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140526592:12345-0@lo:400:kworker.0 Request processed in 38us (548us total) trans 0 rc 0/0 00010000:00080000:3.0:1788664331.339278:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c304833b80 x1875550140527104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664331.339279:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788664331.339296:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140527104:0@lo:400:kworker.0 00010000:00080000:3.0:1788664331.339306:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c304830a80 x1875550140527616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664331.339314:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140527616:0@lo:400:kworker.0 00000100:00100000:3.0:1788664331.339336:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140526592:0@lo:400:kworker.0 00000100:00080000:3.0:1788664331.339353:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788664331.354069:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664331.354143:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140526976:0@lo:400:kworker.0 00000100:00100000:0.0:1788664331.354191:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664331.354223:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140526464 00000100:00100000:0.0:1788664331.354223:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140526976 00000100:00100000:1.0:1788664331.354231:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140526464 00000100:00100000:0.0:1788664331.354231:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140526976 00000100:00100000:0.0:1788664331.354488:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00080000:3.0:1788664331.354524:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664331.356553:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788664331.356572:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140526464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664331.356704:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140526464:12345-0@lo:400:kworker.0 Request processed in 138us (2648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664331.356713:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788664331.356809:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140527488:0@lo:400:kworker.0 00000100:00100000:1.0:1788664331.356855:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664331.356906:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140526336:0@lo:400:kworker.0 00000100:00100000:1.0:1788664331.356924:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140526848:0@lo:400:kworker.0 00000100:00100000:1.0:1788664331.356940:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140527360:0@lo:400:kworker.0 00000100:00100000:2.0:1788664331.359536:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664331.359618:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140527488 00000100:00100000:2.0:1788664331.359628:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140527488 00000100:00100000:2.0:1788664331.359696:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140526720 00000100:00100000:2.0:1788664331.359700:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140526720 00000100:00100000:2.0:1788664331.359720:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788664331.359732:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140527488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664331.359832:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140527488:12345-0@lo:400:kworker.0 Request processed in 103us (2976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.359840:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788664331.359860:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788664331.359866:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140526720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664331.359898:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140526720:12345-0@lo:400:kworker.0 Request processed in 33us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.359905:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788664331.359953:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140526720:0@lo:400:kworker.0 00000100:00100000:2.0:1788664331.359969:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140527232:0@lo:400:kworker.0 00000100:00100000:1.0:1788664331.360253:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140526464:0@lo:400:kworker.0 00000100:00100000:1.0:1788664331.360479:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140527488:0@lo:400:kworker.0 00000100:00100000:2.0:1788664331.360606:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664331.360648:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140527744:0@lo:400:kworker.0 00000100:00100000:2.0:1788664331.360681:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664331.360708:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140527232 00000100:00100000:2.0:1788664331.360713:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140527232 00000100:00100000:2.0:1788664331.360753:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140527744 00000100:00100000:2.0:1788664331.360756:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140527744 00000100:00100000:2.0:1788664331.360804:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788664331.360813:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140527232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664331.360881:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140527232:12345-0@lo:400:kworker.0 Request processed in 69us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.360889:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788664331.360904:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788664331.360910:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140527744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664331.360937:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140527744:12345-0@lo:400:kworker.0 Request processed in 27us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.360943:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788664331.360991:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140527744:0@lo:400:kworker.0 00000100:00100000:0.0:1788664331.362037:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140526976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664331.362134:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140526976:12345-0@lo:400:kworker.0 Request processed in 7636us (7941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664331.362157:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788664331.362214:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140526976:0@lo:400:kworker.0 00000100:00100000:2.0:1788664331.362536:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140526208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664331.362574:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140527232:0@lo:400:kworker.0 00000100:00080000:1.0:1788664331.363988:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664331.364086:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788664331.582112:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664331.582125:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664331.582158:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788664331.582170:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788664331.582364:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304276300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1875550140527872:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788664331.582585:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6840 going to sleep for 11 seconds 00000040:00080000:0.0:1788664331.582748:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788664331.604117:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304276300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1875550140527872:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788664331.611956:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664331.616904:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119499264 00000100:00100000:2.0:1788664331.616925:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119499264 00000100:00100000:2.0:1788664331.618872:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 232 00000100:00100000:2.0:1788664331.618905:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+67:12454:x1875550119499264:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788664331.618953:0:6511:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788664331.619120:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+67:12454:x1875550119499264:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 232us (7178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.619146:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 232 00000100:00080000:1.0:1788664331.622459:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664331.626622:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664331.626823:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119499392 00000100:00100000:2.0:1788664331.626836:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119499392 00000100:00100000:2.0:1788664331.627419:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 233 00000100:00100000:2.0:1788664331.627434:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+67:12454:x1875550119499392:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788664331.627525:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e6c9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.627546:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e6c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.627562:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e6c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.627703:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e6d0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.627728:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.627742:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.627819:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e6d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.627829:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.627834:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664331.627904:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788664331.627909:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664331.627936:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.627949:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e6c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.627956:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e6c9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.627963:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e6c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.627969:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664331.627973:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e6c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.627981:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e6c9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.627993:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c4350d6600) 00010000:00010000:2.0:1788664331.627996:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664331.628001:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e6c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.628008:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413e6c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.628024:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.628041:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e6d0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.628047:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.628052:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030a00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664331.628056:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.628062:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e6d0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.628070:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff93c3038d3800) 00010000:00010000:2.0:1788664331.628073:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664331.628075:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e6d0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.628080:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e6d0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.628096:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.628102:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e6d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.628108:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e6d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.628113:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664331.628122:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e6d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.628129:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e6d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.628136:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:2.0:1788664331.628138:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664331.628141:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e6d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.628147:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e6d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664331.628585:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+67:12454:x1875550119499392:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 1149us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.628596:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 233 00000100:00100000:0.0:1788664331.643159:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664331.643457:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119499648 00000100:00100000:3.0:1788664331.643470:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119499648 00000100:00100000:3.0:1788664331.643556:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 234 00000100:00100000:3.0:1788664331.643894:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+67:12454:x1875550119499648:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664331.643928:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664331.643959:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e6de lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d5f6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.644136:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e6e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.644159:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.644174:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664331.644188:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788664331.645114:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.645128:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e6e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.645137:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.645144:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664331.645150:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.645159:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e6e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.645178:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:3.0:1788664331.645181:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788664331.645188:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e6e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.645498:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e6e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.646484:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e6de lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5f6 expref: 69 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.646506:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c4350d6600) 00010000:00010000:3.0:1788664331.646510:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664331.646517:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e6de lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5f6 expref: 69 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.646535:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a000, rc 0) 00000100:00100000:3.0:1788664331.646676:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+68:12454:x1875550119499648:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 3108us (3533us total) trans 4294967507 rc 301/301 00000100:00100000:3.0:1788664331.646688:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 234 00000100:00100000:3.0:1788664331.651760:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664331.652030:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119499776 00000100:00100000:2.0:1788664331.652043:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119499776 00000100:00100000:2.0:1788664331.652118:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 235 00000100:00100000:2.0:1788664331.652132:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+68:12454:x1875550119499776:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788664331.652185:0:6513:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788664331.652358:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+68:12454:x1875550119499776:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 229us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.652366:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 235 00000100:00100000:0.0:1788664331.670516:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664331.672167:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119500032 00000100:00100000:2.0:1788664331.672187:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119500032 00000100:00100000:2.0:1788664331.672297:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 236 00000100:00100000:2.0:1788664331.672309:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+68:12454:x1875550119500032:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664331.672358:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664331.672362:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788664331.672478:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e683 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5da expref: 68 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.672509:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:2.0:1788664331.672516:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664331.672537:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e6f3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d5fd expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788664331.675804:0:9524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788664331.677654:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e6fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664331.677684:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e6fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664331.677697:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e6fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664331.677805:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e6f3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5fd expref: 70 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664331.677854:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e6fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5fd expref: 69 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664331.677866:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93c303887d00) 00010000:00010000:0.0:1788664331.677869:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664331.677873:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957800, rc 0) 00000100:00100000:0.0:1788664331.677975:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+69:12454:x1875550119500032:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 5666us (7474us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1788664331.677986:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 236 00000100:00100000:0.0:1788664331.684696:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664331.685049:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119500288 00000100:00100000:3.0:1788664331.685063:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119500288 00000100:00100000:3.0:1788664331.685237:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00100000:3.0:1788664331.685252:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+69:12454:x1875550119500288:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788664331.685333:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664331.685370:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957800/0xcd11f61c1413e6fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5fd expref: 69 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.685536:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93c303887d00) 00010000:00010000:3.0:1788664331.685551:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664331.685605:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e708 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.685624:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e708 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.685636:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e708 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686653:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e70f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xf66b5655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686679:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf66b5655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686692:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf66b5655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686748:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e708 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686756:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e708 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686763:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e708 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686804:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664331.686810:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e708 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686819:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e708 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686849:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:3.0:1788664331.686852:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664331.686858:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e708 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686864:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e708 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686881:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf66b5655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686889:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e70f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf66b5655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686896:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e70f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf66b5655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686900:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664331.686903:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e70f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf66b5655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686908:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e70f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf66b5655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686915:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xf66b5655 (ffff93c4350d6500) 00010000:00010000:3.0:1788664331.686917:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664331.686920:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e70f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xf66b5655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.686926:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e70f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xf66b5655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664331.692071:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+68:12454:x1875550119500288:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 6803us (7371us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788664331.692090:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00100000:3.0:1788664331.698767:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664331.698912:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119500416 00000100:00100000:1.0:1788664331.698931:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119500416 00000100:00100000:1.0:1788664331.699034:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 238 00000100:00100000:1.0:1788664331.699047:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+68:12454:x1875550119500416:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664331.699079:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664331.699114:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e716 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d604 expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.699353:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e71d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.699462:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e71d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.699477:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e71d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.699618:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e716 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d604 expref: 70 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.699868:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e71d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d604 expref: 69 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.699882:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93c4047be000) 00010000:00010000:1.0:1788664331.699885:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788664331.699890:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85200, rc 0) 00000100:00100000:1.0:1788664331.700315:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+69:12454:x1875550119500416:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1267us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664331.700326:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 238 00000100:00100000:0.0:1788664331.712387:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664331.712510:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119500672 00000100:00100000:2.0:1788664331.712526:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119500672 00000100:00100000:2.0:1788664331.712603:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 239 00000100:00100000:2.0:1788664331.712616:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+69:12454:x1875550119500672:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788664331.712744:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e724 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.712767:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e724 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.712807:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e724 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788664331.713241:0:9524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:2.0:1788664331.713311:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067cd41f1 reply state 000000003de48489 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e724 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.713326:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e724 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.713354:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93c4047be000) 00010000:00010000:2.0:1788664331.713358:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788664331.713363:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788664331.713512:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+71:12454:x1875550119500672:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 896us (1138us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788664331.713521:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 239 00000100:00100000:0.0:1788664331.716408:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664331.716515:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119500800 00000100:00100000:2.0:1788664331.716528:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119500800 00000100:00100000:2.0:1788664331.716855:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 240 00000100:00100000:2.0:1788664331.716869:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+71:12454:x1875550119500800:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664331.716899:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664331.716924:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e72b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d60b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.717007:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e72b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d60b expref: 72 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.717024:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e72b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d60b expref: 72 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.717048:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93c4047be000) 00010000:00010000:2.0:1788664331.717051:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788664331.717056:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400030800, rc 0) 00000100:00100000:2.0:1788664331.717124:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+72:12454:x1875550119500800:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 257us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.717131:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 240 00010000:00010000:0.0:1788664331.717526:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664331.720889:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664331.721054:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119500928 00000100:00100000:2.0:1788664331.721067:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119500928 00000100:00100000:2.0:1788664331.721302:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:2.0:1788664331.721315:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2391:x1875550119500928:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788664331.721613:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:2391:x1875550119500928:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 300us (739us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788664331.721622:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:0.0:1788664331.724856:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664331.724952:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119501184 00000100:00100000:2.0:1788664331.724974:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119501184 00000100:00100000:2.0:1788664331.725045:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:2.0:1788664331.725058:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+72:12454:x1875550119501184:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788664331.725422:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+73:12454:x1875550119501184:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 365us (579us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1788664331.725432:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00080000:1.0:1788664331.725628:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664331.728318:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664331.728431:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119501440 00000100:00100000:1.0:1788664331.728444:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119501440 00000100:00100000:1.0:1788664331.728519:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 241 00000100:00100000:1.0:1788664331.728532:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+73:12454:x1875550119501440:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788664331.728689:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+73:12454:x1875550119501440:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 159us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664331.728698:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 241 00000100:00100000:0.0:1788664331.731763:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664331.732188:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119501568 00000100:00100000:3.0:1788664331.732202:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119501568 00000100:00100000:3.0:1788664331.732289:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 242 00000100:00100000:3.0:1788664331.732302:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+73:12454:x1875550119501568:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664331.732330:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664331.732357:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e732 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d612 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.732461:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e739 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.732481:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e739 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.732500:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e739 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664331.732558:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788664331.732581:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e739 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.732614:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b200/0xcd11f61c1413e732 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d612 expref: 75 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.732636:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e739 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d612 expref: 74 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.733023:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93c4047be000) 00010000:00010000:3.0:1788664331.733027:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788664331.733032:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a000, rc 0) 00000100:00100000:3.0:1788664331.733124:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+74:12454:x1875550119501568:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 823us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664331.733132:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 242 00000100:00100000:0.0:1788664331.735889:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664331.735989:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119501696 00000100:00100000:2.0:1788664331.736003:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119501696 00000100:00100000:2.0:1788664331.736080:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:2.0:1788664331.736093:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+10:2390:x1875550119501696:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664331.736128:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664331.736158:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a181e7a/0xcd11f61c1413e740 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d619 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664331.736694:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cda0b, blocks: 0x0 00010000:00010000:2.0:1788664331.736726:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1788664331.736732:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664331.736746:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a181e7a/0xcd11f61c1413e740 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d619 expref: 11 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.736832:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a181e7a/0xcd11f61c1413e740 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d619 expref: 11 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.736851:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c400, rc 0) 00000100:00100000:2.0:1788664331.736933:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:2390:x1875550119501696:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 842us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.736943:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:0.0:1788664331.750920:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664331.750998:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119501952 00000100:00100000:2.0:1788664331.751012:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119501952 00000100:00100000:2.0:1788664331.751093:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 243 00000100:00100000:2.0:1788664331.751115:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+74:12454:x1875550119501952:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788664331.751441:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+74:12454:x1875550119501952:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 337us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.751451:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 243 00000100:00100000:0.0:1788664331.756286:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664331.756416:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119502080 00000100:00100000:2.0:1788664331.756430:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119502080 00000100:00100000:2.0:1788664331.756515:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:2.0:1788664331.756528:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:12454:x1875550119502080:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664331.756553:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664331.756581:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f96186f/0xcd11f61c1413e747 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d620 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.756628:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a181e7a/0xcd11f61c1413e740 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d619 expref: 12 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.756667:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664331.756673:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664331.756681:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f96186f/0xcd11f61c1413e747 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d620 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.756729:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a181e7a/0xcd11f61c1413e740 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d619 expref: 12 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.756746:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a181e7a/0xcd11f61c1413e740 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d619 expref: 12 pid: 8426 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664331.756763:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304276300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875550140528000:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664331.756966:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788664331.762926:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664331.763033:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119502208 00000100:00100000:1.0:1788664331.763067:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119502208 00010000:00010000:1.0:1788664331.763138:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a181e7a/0xcd11f61c1413e740 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d619 expref: 13 pid: 8426 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664331.763280:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:1.0:1788664331.763293:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:2390:x1875550119502208:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664331.763318:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664331.763353:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a181e7a/0xcd11f61c1413e740 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d619 expref: 13 pid: 8426 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.763372:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a181e7a/0xcd11f61c1413e740 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d619 expref: 13 pid: 8426 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.763424:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664331.763432:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664331.763443:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f96186f/0xcd11f61c1413e747 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d620 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.763456:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f96186f/0xcd11f61c1413e747 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d620 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.763513:0:8443:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004f96186f/0xcd11f61c1413e747 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d620 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664331.763535:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303aba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8443:1875550140528128:192.168.203.52@tcp:105: 00000100:00100000:1.0:1788664331.763690:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c402f1a840 going to sleep for 11 seconds 00010000:00010000:2.0:1788664331.765069:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a181e7a/0xcd11f61c1413e740 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d619 expref: 13 pid: 8426 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664331.765098:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304276300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875550140528000:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788664331.765149:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f96186f/0xcd11f61c1413e747 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d620 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.765166:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e3c00, rc 0) 00000100:00100000:2.0:1788664331.765257:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+12:12454:x1875550119502080:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 8731us (8986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.765288:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:1.0:1788664331.769033:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303aba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8443:1875550140528128:192.168.203.52@tcp:105: 00010000:00010000:1.0:1788664331.769074:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664331.769336:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:2390:x1875550119502208:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 6043us (6422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664331.769351:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:0.0:1788664331.770957:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664331.771064:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119502336 00000100:00100000:3.0:1788664331.771077:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119502336 00002000:00100000:3.0:1788664331.771150:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff93c303a6e680 x1875550119502336/t0(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:637/0 lens 504/0 e 0 to 0 dl 1788664342 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788664331.771162:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c303a6e680 with x1875550119502336 ext(0->12) 00002000:00010000:3.0:1788664331.771169:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c303a6e680 00000100:00100000:3.0:1788664331.771211:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1788664331.771223:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+11:2390:x1875550119502336:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788664331.778407:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:2390:x1875550119502336:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 7159us (7434us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788664331.778427:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00002000:00100000:2.0:1788664331.778446:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff93c303a6e680 x1875550119502336/t4294967321(0) o4->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:637/0 lens 504/448 e 0 to 0 dl 1788664342 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664331.778457:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c303a6e680 with x1875550119502336 ext(0->12) 00002000:00010000:2.0:1788664331.778465:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c303a6e680 00000100:00100000:0.0:1788664331.783988:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664331.784125:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119502464 00000100:00100000:2.0:1788664331.784140:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119502464 00000100:00100000:2.0:1788664331.784236:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 244 00000100:00100000:2.0:1788664331.784249:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+74:12454:x1875550119502464:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788664331.802416:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967510 is committed 00000004:00080000:0.0:1788664331.802456:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:3.0:1788664331.802737:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664331.802767:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140528256:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788664331.802902:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664331.802977:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140528256 00000100:00100000:3.0:1788664331.802987:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140528256 00000100:00100000:3.0:1788664331.803047:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788664331.803058:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1875550140528256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788664331.803095:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:3.0:1788664331.803143:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6f34982/0xcd11f61c1413e74e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.803589:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413e502 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d578 expref: 12 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.803600:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788664331.803605:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664331.803611:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f34982/0xcd11f61c1413e74e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788664331.803792:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788664331.803815:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c303406540 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788664331.803819:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c303b7c800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c303406000 00000020:00080000:0.0:1788664331.803823:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c303b7c200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c3035ccc00 00000004:00080000:0.0:1788664331.803855:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788664331.803885:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c3038a10c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788664331.803888:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c4081a3300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c403ce8cc0 00000020:00080000:0.0:1788664331.803891:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c4081a3d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c3035cd800 00000100:00100000:3.0:1788664331.804007:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140528384:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788664331.804070:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664331.804145:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140528384 00000100:00100000:3.0:1788664331.804152:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140528384 00000100:00100000:3.0:1788664331.804209:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788664331.804219:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3639:x1875550140528384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788664331.804241:0:9895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1788664331.804277:0:9895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9cda0a, atime: 0x6a9cda0a, ctime: 0x6a9cda0a, blocks: 0x8 00010000:00010000:3.0:1788664331.804284:0:9895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008947f73d/0xcd11f61c1413e755 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.804296:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788664331.804300:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664331.804307:0:9895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008947f73d/0xcd11f61c1413e755 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.804325:0:9895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008947f73d/0xcd11f61c1413e755 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.804351:0:9895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008947f73d/0xcd11f61c1413e755 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.804360:0:9895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008947f73d/0xcd11f61c1413e755 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.804381:0:9895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788664331.807593:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3639:x1875550140528384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3360us (3506us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788664331.807611:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1788664331.807683:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664331.807695:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008947f73d/0xcd11f61c1413e755 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.807712:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ac00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664331.807718:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008947f73d/0xcd11f61c1413e755 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.807731:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008947f73d/0xcd11f61c1413e755 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.807757:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008947f73d/0xcd11f61c1413e755 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.807767:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008947f73d/0xcd11f61c1413e755 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.807837:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664331.807840:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664331.807842:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788664331.807891:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c30480ce00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788664331.807899:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140528384:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788664331.808606:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e44c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808625:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e44c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808633:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e44c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808639:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664331.808656:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e44c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808665:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e44c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808682:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93c4130a6000) 00010000:00010000:1.0:1788664331.808686:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664331.808692:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e44c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808699:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a600/0xcd11f61c1413e44c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808736:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413e4f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808762:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413e4f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808768:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413e4f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808823:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ba00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664331.808826:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413e4f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808833:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413e4f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808843:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93c4130a6f00) 00010000:00010000:1.0:1788664331.808846:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664331.808849:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413e4f4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808856:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ba00/0xcd11f61c1413e4f4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808877:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e572 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808884:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e572 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808890:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e572 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808896:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502be00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664331.808905:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e572 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808912:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e572 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808921:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c4350d6c00) 00010000:00010000:1.0:1788664331.808923:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664331.808926:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e572 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808932:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502be00/0xcd11f61c1413e572 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808945:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e595 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808951:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e595 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808958:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e595 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808963:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956c00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664331.808966:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e595 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808973:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e595 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.808980:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c4350d6c00) 00010000:00010000:1.0:1788664331.808983:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664331.808994:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e595 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.809000:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e595 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.809019:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e667 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.809026:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e667 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.809032:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e667 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.809038:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664331.809041:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e667 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.809047:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e667 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.809055:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:1.0:1788664331.809057:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664331.809060:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e667 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.809066:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413e667 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.809078:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e724 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.809083:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e724 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.809095:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e724 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.809100:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030a00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664331.809103:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e724 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.809121:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e724 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.809130:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93c4047be000) 00010000:00010000:1.0:1788664331.809133:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788664331.809136:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e724 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.809143:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413e724 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788664331.809843:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788664331.809944:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:2.0:1788664331.810354:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413e502 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d578 expref: 12 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.810385:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413e502 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d578 expref: 12 pid: 9895 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664331.810419:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304276300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1875550140528512:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664331.811605:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:12454:x1875550119502464:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 27347us (27623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664331.811620:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 244 00000100:00100000:2.0:1788664331.811866:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788664331.819879:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664331.819924:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664331.819958:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119502720 00000100:00100000:0.0:1788664331.819969:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119502720 00010000:00010000:0.0:1788664331.820019:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413e502 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d578 expref: 13 pid: 9895 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664331.820065:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:0.0:1788664331.820078:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:2391:x1875550119502720:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664331.820098:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664331.820119:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413e502 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d578 expref: 13 pid: 9895 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664331.820136:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413e502 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d578 expref: 13 pid: 9895 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664331.820202:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664331.820209:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664331.820217:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6f34982/0xcd11f61c1413e74e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664331.820228:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f34982/0xcd11f61c1413e74e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664331.820254:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664331.820322:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+13:2391:x1875550119502720:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 246us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664331.820331:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 101 00010000:00010000:3.0:1788664331.821084:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413e502 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d578 expref: 12 pid: 9895 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664331.821123:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304276300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1875550140528512:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664331.821151:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c6f34982/0xcd11f61c1413e74e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.821165:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c6f34982/0xcd11f61c1413e74e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.821186:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6f34982/0xcd11f61c1413e74e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.821199:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6f34982/0xcd11f61c1413e74e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.821228:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f34982/0xcd11f61c1413e74e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.821249:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788664331.821757:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1875550140528256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18695us (18850us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788664331.821807:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788664331.821839:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119502592 00000100:00100000:3.0:1788664331.821846:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119502592 00000100:00100000:3.0:1788664331.821891:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:3.0:1788664331.821901:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+12:2391:x1875550119502592:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1788664331.822275:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664331.822286:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6f34982/0xcd11f61c1413e74e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664331.822300:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b200 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664331.822305:0:7453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6f34982/0xcd11f61c1413e74e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664331.822317:0:7453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6f34982/0xcd11f61c1413e74e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664331.822341:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6f34982/0xcd11f61c1413e74e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664331.822362:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6f34982/0xcd11f61c1413e74e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664331.822391:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664331.822414:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664331.822416:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788664331.823627:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c30480ea00/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788664331.824059:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140528256:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788664331.827102:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1788664331.827273:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1788664331.828303:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119502592:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 6389us (8425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.828344:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:0.0:1788664331.833419:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664331.833728:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119502976 00000100:00100000:3.0:1788664331.833743:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119502976 00000100:00100000:3.0:1788664331.833916:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 245 00000100:00100000:3.0:1788664331.833930:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:12454:x1875550119502976:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788664331.834005:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664331.834040:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e739 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d612 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.834065:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93c4047be000) 00010000:00010000:3.0:1788664331.834073:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664331.834120:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e75c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.834164:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e75c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.834185:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e75c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664331.834348:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf3dd63d reply state 000000000bc3247c transno 4294967511 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e75c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.834362:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e75c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.834369:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93c4047be000) 00010000:00010000:3.0:1788664331.834373:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788664331.834376:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788664331.834908:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:12454:x1875550119502976:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 978us (1511us total) trans 4294967511 rc 0/0 00000100:00100000:3.0:1788664331.834917:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 245 00000100:00100000:0.0:1788664331.837070:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664331.837376:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119503104 00000100:00100000:3.0:1788664331.837390:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119503104 00000100:00100000:3.0:1788664331.837475:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:3.0:1788664331.837496:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119503104:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788664331.838628:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664331.838672:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140528640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664331.838822:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664331.839094:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140528640 00000100:00100000:1.0:1788664331.839116:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140528640 00000100:00100000:1.0:1788664331.839203:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788664331.839214:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140528640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788664331.839247:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1788664331.839309:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140528640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664331.839318:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788664331.839626:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140528640:0@lo:13:osp-pre-1-1.0 00002000:00010000:0.0:1788664331.841750:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788664331.841766:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788664330 00002000:00010000:0.0:1788664331.841929:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788664330 00002000:00010000:0.0:1788664331.841933:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788664331 -> 1788664330 00002000:00010000:0.0:1788664331.841935:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788664331.842291:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2391:x1875550119503104:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 4790us (5228us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788664331.842306:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:0.0:1788664331.844919:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664331.845084:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119503360 00000100:00100000:1.0:1788664331.845117:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119503360 00000100:00100000:1.0:1788664331.845297:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 246 00000100:00100000:1.0:1788664331.845310:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:12454:x1875550119503360:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788664331.845416:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e763 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.845438:0:9169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e71d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d604 expref: 22 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.845450:0:9169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e763 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.845509:0:9169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e71d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d604 expref: 22 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.845526:0:9169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e71d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d604 expref: 22 pid: 9169 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664331.845545:0:9169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9169:1875550140528768:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664331.845659:0:9169:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c402f1a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788664331.856626:0:9169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9169:1875550140528768:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664331.856665:0:9169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e763 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664331.857905:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664331.858099:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119503488 00000100:00100000:2.0:1788664331.858111:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119503488 00010000:00010000:2.0:1788664331.858164:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e71d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d604 expref: 23 pid: 9169 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664331.858216:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:2.0:1788664331.858227:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+23:2391:x1875550119503488:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664331.858246:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664331.858253:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e71d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d604 expref: 23 pid: 9169 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.858268:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e71d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d604 expref: 23 pid: 9169 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.858293:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e71d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d604 expref: 23 pid: 9169 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.858311:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93c4047be000) 00010000:00010000:2.0:1788664331.858317:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e763 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.858343:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e763 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.858353:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e763 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.858385:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664331.858462:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:2391:x1875550119503488:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 237us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.858470:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 102 00010000:00010000:1.0:1788664331.858635:0:9169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e763 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.858646:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e763 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.858710:0:9169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e763 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.858718:0:9169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e763 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.858726:0:9169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e763 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.858733:0:9169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85c00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664331.858738:0:9169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e763 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.858746:0:9169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e763 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.858756:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93c4047be000) 00010000:00010000:1.0:1788664331.858759:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788664331.858762:0:9169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e763 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.858792:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e763 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664331.858847:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:12454:x1875550119503360:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 13540us (13945us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788664331.858855:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 246 00000100:00100000:0.0:1788664331.861714:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664331.861906:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119503616 00000100:00100000:3.0:1788664331.861918:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119503616 00000100:00100000:3.0:1788664331.862067:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:3.0:1788664331.862080:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2390:x1875550119503616:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788664331.862142:0:9895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413e76a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.862295:0:9895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f96186f/0xcd11f61c1413e747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d620 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.862305:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664331.862310:0:9895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664331.862315:0:9895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413e76a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.862362:0:9895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f96186f/0xcd11f61c1413e747 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d620 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.862379:0:9895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f96186f/0xcd11f61c1413e747 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d620 expref: 8 pid: 8429 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664331.862406:0:9895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9895:1875550140528896:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664331.863363:0:9895:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664331.873080:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664331.873171:0:9895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9895:1875550140528896:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664331.873214:0:9895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413e76a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664331.873313:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119503744 00000100:00100000:1.0:1788664331.873325:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119503744 00010000:00010000:1.0:1788664331.873383:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f96186f/0xcd11f61c1413e747 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d620 expref: 9 pid: 8429 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664331.873468:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:1.0:1788664331.873490:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304276d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+9:2391:x1875550119503744:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664331.873513:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664331.873541:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000004f96186f/0xcd11f61c1413e747 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d620 expref: 9 pid: 8429 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.873557:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f96186f/0xcd11f61c1413e747 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d620 expref: 9 pid: 8429 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.873590:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f96186f/0xcd11f61c1413e747 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d620 expref: 9 pid: 8429 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.873614:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1788664331.873618:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664331.873625:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413e76a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.873636:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413e76a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.873661:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664331.873736:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304276d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2391:x1875550119503744:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 257us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664331.873745:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 103 00010000:00010000:2.0:1788664331.874240:0:9895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413e76a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.874253:0:9895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413e76a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.874282:0:9895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413e76a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.874290:0:9895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413e76a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.874297:0:9895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413e76a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.874305:0:9895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ae00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:2.0:1788664331.874320:0:9895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413e76a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.874328:0:9895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413e76a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.874342:0:9895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413e76a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.874350:0:9895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413e76a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664331.874433:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2390:x1875550119503616:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 12356us (12733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.874442:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:2.0:1788664331.881242:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664331.881343:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119504000 00000100:00100000:3.0:1788664331.881360:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119504000 00000100:00100000:3.0:1788664331.881441:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 247 00000100:00100000:3.0:1788664331.881453:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:12454:x1875550119504000:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788664331.881556:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e771 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.881575:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e660 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5cc expref: 21 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.881585:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e771 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.881621:0:9524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e660 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5cc expref: 21 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.881637:0:9524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e660 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5cc expref: 21 pid: 9169 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664331.881651:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9524:1875550140529024:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664331.881752:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664331.887825:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664331.887926:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119504128 00000100:00100000:3.0:1788664331.887977:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9524:1875550140529024:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664331.888005:0:9524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e771 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664331.888015:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119504128 00010000:00010000:1.0:1788664331.888086:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e660 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5cc expref: 22 pid: 9169 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664331.888222:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:1.0:1788664331.888235:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:2390:x1875550119504128:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664331.888257:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664331.888266:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e660 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5cc expref: 22 pid: 9169 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.888281:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e660 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5cc expref: 22 pid: 9169 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.888311:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502bc00/0xcd11f61c1413e660 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5cc expref: 22 pid: 9169 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.888333:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:1.0:1788664331.888340:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e6c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5ef expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.888352:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e771 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.888360:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.888368:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e771 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.888433:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664331.888510:0:9524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.888521:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664331.888539:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:2390:x1875550119504128:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 302us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664331.888551:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 104 00010000:00010000:3.0:1788664331.888980:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e778 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.889018:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e72b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d60b expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.889028:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e778 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.889194:0:9524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e72b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d60b expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.889280:0:9524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e72b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d60b expref: 21 pid: 6512 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664331.889296:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9524:1875550140529152:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664331.889381:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086180 going to sleep for 11 seconds 00000100:00100000:3.0:1788664331.891696:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9524:1875550140529152:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788664331.891722:0:9524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e778 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664331.892283:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664331.897105:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119504256 00000100:00100000:2.0:1788664331.897128:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119504256 00010000:00010000:2.0:1788664331.897201:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e72b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d60b expref: 22 pid: 6512 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664331.897314:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:2.0:1788664331.897328:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:2391:x1875550119504256:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664331.897350:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664331.897359:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e72b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d60b expref: 22 pid: 6512 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.897491:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e72b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d60b expref: 22 pid: 6512 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.897520:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413e72b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d60b expref: 22 pid: 6512 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.897651:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93c4047be000) 00010000:00010000:2.0:1788664331.897659:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e778 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.897671:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e778 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.897741:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e778 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.897802:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664331.898050:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:2391:x1875550119504256:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 723us (5767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.898059:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 105 00010000:00010000:2.0:1788664331.898856:0:9524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e778 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.898870:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e778 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664331.899042:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:2.0:1788664331.899190:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000001:00080000:2.0:1788664331.899234:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:2.0:1788664331.899358:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304275880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9524:1875550140529280:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788664331.899597:0:9524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664331.899659:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c44216f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788664331.902930:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140529280 00000100:00100000:1.0:1788664331.902965:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140529280 00000100:00100000:1.0:1788664331.903052:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788664331.903069:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9524:x1875550140529280:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788664331.903265:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9524:x1875550140529280:12345-0@lo:1000:mdt00_004.0 Request processed in 201us (3676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664331.903275:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788664331.904100:0:9524:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788664331.904113:0:9524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1788664331.904139:0:9524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c30480ea00, transno 4294967322 00000100:00100000:2.0:1788664331.904170:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304275880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9524:1875550140529280:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788664331.904320:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00000100:00100000:2.0:1788664331.904384:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304275880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9524:1875550140529408:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788664331.904457:0:9524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664331.904543:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6840 going to sleep for 11 seconds 00000100:00100000:1.0:1788664331.905730:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140529408 00000100:00100000:1.0:1788664331.905742:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140529408 00000100:00100000:0.0:1788664331.907647:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788664331.907667:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9524:x1875550140529408:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788664331.907915:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9524:x1875550140529408:12345-0@lo:1000:mdt00_004.0 Request processed in 256us (3457us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788664331.907988:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304275880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9524:1875550140529408:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788664331.908043:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e778 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.908053:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e778 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.908060:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e778 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.908079:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664331.908083:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e778 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.908091:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e778 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.908107:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93c4047be000) 00010000:00010000:3.0:1788664331.908110:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664331.908115:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e778 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.908121:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b600/0xcd11f61c1413e778 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.908145:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e6bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.908150:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e6bb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.908155:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e6bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.908160:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ca00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664331.908163:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e6bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.908169:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e6bb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.908187:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:3.0:1788664331.908189:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664331.908197:0:9524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e6c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5ef expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.908209:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e6c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5ef expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.908218:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e6c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5ef expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.908253:0:9524:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e6c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5ef expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664331.908268:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9524:1875550140529536:192.168.203.52@tcp:105: 00000100:00100000:3.0:1788664331.908348:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664331.908614:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788664331.913268:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9524:1875550140529536:192.168.203.52@tcp:105: 00010000:00010000:3.0:1788664331.913300:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e6bb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913311:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413e6bb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913344:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e77f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913359:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e77f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913387:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e77f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913406:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e77f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913412:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e77f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913417:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e77f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913422:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664331.913427:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e77f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913434:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e77f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913445:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:3.0:1788664331.913448:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664331.913452:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e77f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913457:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e77f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913467:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913473:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e771 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913484:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e771 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913489:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664331.913492:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e771 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913499:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e771 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913507:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:3.0:1788664331.913510:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788664331.913513:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e771 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664331.913518:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e771 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664331.913727:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:12454:x1875550119504000:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 32275us (32501us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788664331.913738:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 247 00000020:00080000:3.0:1788664331.913744:0:9524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788664331.914841:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664331.915130:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119504384 00000100:00100000:0.0:1788664331.915139:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119504384 00000100:00100000:0.0:1788664331.915188:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:0.0:1788664331.915197:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:12453:x1875550119504384:12345-192.168.203.52@tcp:49:lfs.0 00000100:00100000:0.0:1788664331.915304:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:12453:x1875550119504384:12345-192.168.203.52@tcp:49:lfs.0 Request processed in 107us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664331.915312:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:0.0:1788664331.917142:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664331.917220:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119504640 00000100:00100000:1.0:1788664331.917229:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119504640 00000100:00100000:1.0:1788664331.917281:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:1.0:1788664331.917291:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c406b61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+24:12454:x1875550119504640:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788664331.917545:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788664331.917580:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967517 00010000:00010000:1.0:1788664331.917617:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e786 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.917633:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e786 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.917752:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e786 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.917947:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e786 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.917955:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e786 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.917961:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e786 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788664331.918292:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664331.918297:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664331.919115:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788664331.919128:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788664331.919509:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788664331.919633:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c406b61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+26:12454:x1875550119504640:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 2339us (2494us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788664331.919651:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000020:00080000:1.0:1788664331.919656:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788664331.920333:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664331.920344:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e786 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.920353:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84200 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:2.0:1788664331.920358:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e786 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.920367:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e786 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.920382:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93c4047be000) 00010000:00010000:2.0:1788664331.920386:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788664331.920390:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e786 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.920417:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84200/0xcd11f61c1413e786 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.920432:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664331.920433:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664331.920435:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664331.939873:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664331.939915:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664331.939971:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664331.939997:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119504896 00000100:00100000:0.0:1788664331.940008:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664331.940016:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119504896 00000100:00100000:0.0:1788664331.940046:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664331.940081:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664331.940342:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119505024 00000100:00100000:1.0:1788664331.940353:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119505024 00000100:00100000:1.0:1788664331.940420:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 398 00000100:00100000:1.0:1788664331.940431:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2391:x1875550119505024:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664331.940507:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2391:x1875550119505024:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 78us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664331.940515:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 398 00000100:00100000:3.0:1788664331.940609:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119505152 00000100:00100000:3.0:1788664331.940750:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119505152 00000100:00080000:1.0:1788664331.942024:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788664331.949944:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119505408 00000100:00100000:0.0:1788664331.949961:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119505408 00000100:00100000:0.0:1788664331.950025:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119505536 00000100:00100000:0.0:1788664331.950028:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119505536 00000100:00100000:0.0:1788664331.950047:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 372 00000100:00100000:0.0:1788664331.950057:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119505152:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664331.950157:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119505152:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 101us (10241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664331.950165:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 372 00000100:00100000:0.0:1788664331.950237:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 373 00000100:00100000:0.0:1788664331.950244:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119505408:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664331.950288:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119505408:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 45us (10284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664331.950308:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 373 00000100:00100000:0.0:1788664331.950410:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 374 00000100:00100000:0.0:1788664331.950417:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119505536:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664331.950444:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2391:x1875550119505536:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 28us (10363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664331.950450:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 374 00000100:00100000:0.0:1788664331.950483:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 248 00000100:00100000:0.0:1788664331.950490:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+26:12453:x1875550119504896:12345-192.168.203.52@tcp:58:lfs.0 00000040:00080000:0.0:1788664331.950651:0:9169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788664331.950706:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+26:12453:x1875550119504896:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 216us (10843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664331.950713:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 248 00000100:00080000:1.0:1788664331.951024:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664331.951029:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664331.951916:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119505280 00000100:00100000:3.0:1788664331.951931:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119505280 00000100:00100000:3.0:1788664331.952865:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 157 00000100:00100000:3.0:1788664331.952881:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119505280:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664331.953066:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2391:x1875550119505280:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 189us (13020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664331.953075:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 157 00000100:00080000:0.0:1788664331.953184:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664331.999197:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664332.003872:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119505664 00000100:00100000:0.0:1788664332.003897:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119505664 00000100:00100000:0.0:1788664332.004155:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 249 00000100:00100000:0.0:1788664332.004170:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+26:12456:x1875550119505664:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664332.004211:0:9169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664332.004240:0:9169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e78d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d627 expref: -99 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.004332:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e794 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.004372:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e794 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.005912:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e794 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.005974:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e79b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.005987:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e79b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.005999:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e79b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.006122:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e7a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.006138:0:9169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e8 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.006153:0:9169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e7a2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.006218:0:9169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e8 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.006240:0:9169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e8 expref: 27 pid: 6512 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664332.006374:0:9169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9169:1875550140529664:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788664332.006708:0:9169:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664332.016155:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664332.016592:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119505920 00000100:00100000:3.0:1788664332.016604:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119505920 00000100:00100000:3.0:1788664332.016691:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:3.0:1788664332.016701:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+28:6161:x1875550119505920:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788664332.017507:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+29:6161:x1875550119505920:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 800us (1360us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788664332.017518:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:0.0:1788664332.018875:0:9169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9169:1875550140529664:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788664332.018914:0:9169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e7a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664332.022503:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664332.023097:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119506048 00000100:00100000:0.0:1788664332.023113:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119506048 00010000:00010000:0.0:1788664332.023171:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e8 expref: 29 pid: 6512 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664332.023220:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:0.0:1788664332.023230:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+29:2391:x1875550119506048:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664332.023251:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664332.023259:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e8 expref: 29 pid: 6512 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.023275:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e8 expref: 29 pid: 6512 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.023302:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413e6ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5e8 expref: 29 pid: 6512 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.023324:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:0.0:1788664332.023331:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e7a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.023366:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.023375:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e7a2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.023473:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664332.023556:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+28:2391:x1875550119506048:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 327us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664332.023565:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 106 00010000:00010000:2.0:1788664332.024687:0:9169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.024705:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664332.024803:0:9169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788664332.024809:0:9169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664332.025068:0:9169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025091:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025102:0:9169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e794 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025110:0:9169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e794 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025118:0:9169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e794 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025124:0:9169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664332.025128:0:9169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e794 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025230:0:9169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e794 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025250:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:2.0:1788664332.025253:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664332.025258:0:9169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e794 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025264:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957400/0xcd11f61c1413e794 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025533:0:9169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e79b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025541:0:9169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e79b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025548:0:9169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e79b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025554:0:9169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957e00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664332.025556:0:9169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e79b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025563:0:9169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e79b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025571:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93c303887600) 00010000:00010000:2.0:1788664332.025574:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664332.025576:0:9169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e79b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025594:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e79b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025654:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957a00/0xcd11f61c1413e78d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d627 expref: 28 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025672:0:9169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e7a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d627 expref: 27 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664332.025681:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:2.0:1788664332.025684:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664332.025687:0:9169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957200, rc 0) 00000100:00100000:2.0:1788664332.026591:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+27:12456:x1875550119505664:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 22412us (27395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664332.026606:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 249 00000100:00100000:3.0:1788664332.350170:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664332.350201:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140529792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788664332.350300:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664332.354126:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140529792 00000100:00100000:1.0:1788664332.354166:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140529792 00000100:00100000:1.0:1788664332.354323:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788664332.354336:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140529792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664332.354398:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788664332.354520:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140529792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 186us (4220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664332.354529:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788664332.354619:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140529792:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788664332.737600:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664332.862302:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664332.862337:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140529920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664332.862447:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664332.862584:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140529920 00000100:00100000:1.0:1788664332.862594:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140529920 00000100:00100000:1.0:1788664332.862662:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788664332.862674:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140529920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788664332.862717:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664332.862810:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140529920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664332.862818:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788664332.862874:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140529920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788664332.863232:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664332.863247:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140530048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664332.863292:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664332.863332:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140530048 00000100:00100000:1.0:1788664332.863338:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140530048 00000100:00100000:1.0:1788664332.863405:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788664332.863413:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303aba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875550140530048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664332.863429:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664332.863472:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303aba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875550140530048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664332.863488:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1788664332.863506:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664332.863710:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140530048:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788664332.926713:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788664332.926725:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788664332.926760:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788664332.926948:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788664332.927307:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1875550140530176:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788664332.927455:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406b8f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664332.933935:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1875550140530176:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788664332.942725:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664332.943018:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119506176 00000100:00100000:0.0:1788664332.943033:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119506176 00000100:00100000:0.0:1788664332.943125:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 250 00000100:00100000:0.0:1788664332.943138:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+27:12467:x1875550119506176:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788664332.943187:0:6513:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788664332.943329:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+27:12467:x1875550119506176:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 194us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664332.943338:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 250 00000100:00100000:2.0:1788664332.953006:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664332.953825:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119506432 00000100:00100000:3.0:1788664332.953842:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119506432 00000100:00100000:3.0:1788664332.953930:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 251 00000100:00100000:3.0:1788664332.953944:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+27:12467:x1875550119506432:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664332.953972:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664332.954000:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e7a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d62e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664332.954821:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e7b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664332.954847:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664332.954865:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664332.954880:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788664332.955027:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e7a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d62e expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664332.955049:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d62e expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664332.955059:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:3.0:1788664332.955062:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664332.955067:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a800, rc 0) 00000100:00100000:3.0:1788664332.956225:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+29:12467:x1875550119506432:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 2272us (3223us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788664332.956239:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 251 00000100:00100000:1.0:1788664332.970462:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664332.970514:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664332.970586:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119506816 00000100:00100000:3.0:1788664332.970600:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119506816 00000100:00100000:3.0:1788664332.970694:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788664332.970707:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+29:2391:x1875550119506816:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664332.970729:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664332.970941:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e7b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d62e expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664332.970962:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:3.0:1788664332.970969:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664332.971038:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+28:2391:x1875550119506816:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 333us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664332.971046:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1788664332.972026:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119506688 00000100:00100000:0.0:1788664332.972039:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119506688 00000100:00100000:0.0:1788664332.972112:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 252 00000100:00100000:0.0:1788664332.972124:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+28:12467:x1875550119506688:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788664332.972220:0:9169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e7be lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.972252:0:9169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e7be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.972267:0:9169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e7be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.972497:0:9169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e7be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.972505:0:9169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e7be lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.972512:0:9169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e7be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.972518:0:9169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956c00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664332.972524:0:9169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e7be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.972531:0:9169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e7be lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.972544:0:9169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:0.0:1788664332.972547:0:9169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788664332.972551:0:9169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e7be lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664332.972557:0:9169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956c00/0xcd11f61c1413e7be lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664332.972717:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+29:12467:x1875550119506688:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 593us (2270us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788664332.972733:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 252 00000040:00080000:0.0:1788664332.972898:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788664332.972904:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788664332.973381:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788664332.973404:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788664332.983355:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664332.986290:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119507072 00000100:00100000:3.0:1788664332.986314:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119507072 00000100:00100000:3.0:1788664332.986466:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:3.0:1788664332.986481:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+29:12467:x1875550119507072:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788664332.986860:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+30:12467:x1875550119507072:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 380us (3518us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788664332.986870:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000040:00080000:0.0:1788664333.029952:0:14757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788664333.029965:0:14757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788664333.030000:0:14757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788664333.030006:0:14757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788664333.245684:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664333.245816:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119507328 00000100:00100000:3.0:1788664333.245830:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119507328 00000100:00100000:3.0:1788664333.245917:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 253 00000100:00100000:3.0:1788664333.245929:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+30:12480:x1875550119507328:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664333.245963:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664333.245990:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e7c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d635 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.246137:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e7cc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.246156:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e7cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.246189:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e7cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664333.246202:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788664333.246358:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a800/0xcd11f61c1413e7c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d635 expref: 33 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.246380:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e7cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d635 expref: 32 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.246402:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:3.0:1788664333.246406:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788664333.246410:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a000, rc 0) 00000100:00100000:3.0:1788664333.246483:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+32:12480:x1875550119507328:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 556us (812us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788664333.246492:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 253 00000100:00080000:0.0:1788664333.246648:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664333.251700:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664333.251847:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119507456 00000100:00100000:0.0:1788664333.251861:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119507456 00000100:00100000:0.0:1788664333.251942:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 254 00000100:00100000:0.0:1788664333.251955:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+32:12480:x1875550119507456:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1788664333.252054:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e7da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.252078:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e7da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.252093:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e7da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.252145:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e7da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.252154:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e7da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.252173:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e7da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.252180:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957e00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664333.252186:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e7da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.252195:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e7da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.252210:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:0.0:1788664333.252214:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788664333.252220:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e7da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.252227:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957e00/0xcd11f61c1413e7da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664333.252328:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+32:12480:x1875550119507456:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 375us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664333.252338:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 254 00000100:00100000:0.0:1788664333.385983:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664333.386090:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119507584 00000100:00100000:2.0:1788664333.386105:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119507584 00000100:00100000:2.0:1788664333.386204:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:2.0:1788664333.386218:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2390:x1875550119507584:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:2.0:1788664333.386263:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664333.386289:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090af938b/0xcd11f61c1413e7e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d63c expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664333.386323:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9cda0a, atime: 0x6a9cda0a, ctime: 0x6a9cda0a, blocks: 0x8 00010000:00010000:2.0:1788664333.386349:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788664333.386354:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664333.386365:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090af938b/0xcd11f61c1413e7e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d63c expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.386398:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090af938b/0xcd11f61c1413e7e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d63c expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.386414:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e2a00, rc 0) 00000100:00100000:2.0:1788664333.386492:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2390:x1875550119507584:12345-192.168.203.52@tcp:101:cat.0 Request processed in 278us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664333.386501:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00080000:0.0:1788664333.386665:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664333.392247:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664333.397846:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119507712 00000100:00100000:3.0:1788664333.397870:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119507712 00002000:00100000:3.0:1788664333.397952:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff93c42266b480 x1875550119507712/t0(0) o3->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:639/0 lens 488/0 e 0 to 0 dl 1788664344 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788664333.397966:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c42266b480 with x1875550119507712 ext(0->4095) 00002000:00010000:3.0:1788664333.397974:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c42266b480 00000100:00100000:3.0:1788664333.398009:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1788664333.398021:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2391:x1875550119507712:12345-192.168.203.52@tcp:3:cat.0 00000100:00100000:3.0:1788664333.398268:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2391:x1875550119507712:12345-192.168.203.52@tcp:3:cat.0 Request processed in 247us (6033us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788664333.398296:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00002000:00100000:3.0:1788664333.398305:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff93c42266b480 x1875550119507712/t0(0) o3->b07edea8-5696-4cd5-9a12-cefd3a8358e9@192.168.203.52@tcp:639/0 lens 488/4536 e 0 to 0 dl 1788664344 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788664333.398314:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c42266b480 with x1875550119507712 ext(0->4095) 00002000:00010000:3.0:1788664333.398318:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c42266b480 00010000:00010000:0.0:1788664333.758406:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664334.787654:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664335.806087:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664335.937573:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140530304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664335.937683:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664335.937967:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140530304 00000100:00100000:1.0:1788664335.937976:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140530304 00000100:00100000:1.0:1788664335.938032:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788664335.938041:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140530304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788664335.938088:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788664335.938152:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140530304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664335.938160:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000001:00080000:1.0:1788664335.939342:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1788664335.939362:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1788664335.948191:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140530304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664336.446319:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140530432:0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.446401:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664336.446467:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140530944:0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.446511:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664336.446534:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140531456:0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.446558:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664336.446585:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788664336.446592:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140530816:0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.446617:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664336.446637:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140531328:0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.446663:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664336.446690:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140531840:0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.446715:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664336.446758:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140530560:0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.446813:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788664336.448918:0:9900:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 431586142956ns, next at 432586138904ns, rc = 0 00000100:00100000:2.0:1788664336.448987:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140531328 00000100:00100000:2.0:1788664336.448997:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140531328 00000100:00100000:2.0:1788664336.449073:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140531840 00000100:00100000:2.0:1788664336.449079:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140531840 00000100:00100000:2.0:1788664336.449112:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788664336.449123:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140531328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664336.449240:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140531328:12345-0@lo:400:kworker.0 Request processed in 119us (2575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664336.449256:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788664336.449275:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788664336.449281:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1875550140531840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664336.449315:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1875550140531840:12345-0@lo:400:kworker.0 Request processed in 34us (2601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664336.449321:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788664336.455434:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140531072:0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.455509:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664336.458306:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140530944 00000100:00100000:3.0:1788664336.458328:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140530944 00000100:00100000:3.0:1788664336.458625:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140531456 00000100:00100000:3.0:1788664336.458630:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140531456 00000100:00100000:3.0:1788664336.458652:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140530816 00000100:00100000:3.0:1788664336.458656:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140530816 00000100:00100000:3.0:1788664336.458676:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140530560 00000100:00100000:3.0:1788664336.458680:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140530560 00000100:00100000:3.0:1788664336.458710:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788664336.458726:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140530944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.459758:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140531584:0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.459839:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664336.459864:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788664336.459872:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140530688:0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.459898:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664336.460044:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140531200:0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.460071:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664336.460093:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140531712:0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.460112:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664336.460152:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140531072 00000100:00100000:0.0:1788664336.460173:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140531072 00000100:00100000:0.0:1788664336.460502:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140531584 00000100:00100000:0.0:1788664336.460506:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140531584 00000100:00100000:0.0:1788664336.460526:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788664336.460533:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140531456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.460587:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140531456:12345-0@lo:400:kworker.0 Request processed in 54us (14028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664336.460593:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788664336.460611:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788664336.460617:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140530816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.460644:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140530816:12345-0@lo:400:kworker.0 Request processed in 28us (14027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664336.460649:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788664336.460661:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788664336.460667:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140530560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.460701:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140530560:12345-0@lo:400:kworker.0 Request processed in 35us (13888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664336.460707:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788664336.460719:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788664336.460725:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140531072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.460750:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140531072:12345-0@lo:400:kworker.0 Request processed in 26us (5241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664336.460757:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788664336.460767:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788664336.460804:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140531584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.460830:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140531584:12345-0@lo:400:kworker.0 Request processed in 28us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664336.460844:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788664336.460865:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140531200 00000100:00100000:0.0:1788664336.460869:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140531200 00000100:00100000:0.0:1788664336.460892:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140531712 00000100:00100000:0.0:1788664336.460894:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140531712 00000100:00100000:0.0:1788664336.460907:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788664336.460912:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140531200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.461073:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140531200:12345-0@lo:400:kworker.0 Request processed in 160us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664336.461079:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788664336.461091:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788664336.461096:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140531712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.461123:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140531712:12345-0@lo:400:kworker.0 Request processed in 27us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664336.461128:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1788664336.461144:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788664336.461148:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664336.461150:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664336.461152:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664336.461167:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140530688 00000100:00100000:0.0:1788664336.461171:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140530688 00000100:00100000:3.0:1788664336.461554:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140530944:12345-0@lo:400:kworker.0 Request processed in 2824us (15034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664336.461570:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788664336.461795:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788664336.461808:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140530688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.461860:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140530688:12345-0@lo:400:kworker.0 Request processed in 56us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664336.461867:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788664336.461900:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664336.462099:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140530432 00000100:00100000:1.0:1788664336.462105:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140530432 00000100:00100000:1.0:1788664336.462137:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1788664336.462144:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140530432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664336.462180:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a681e771-e9ab-478d-af58-39fce2e20de6+24:3637:x1875550140530432:12345-0@lo:400:kworker.0 Request processed in 37us (15780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664336.462394:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1788664336.462488:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140530816:0@lo:400:kworker.0 00000100:00100000:1.0:1788664336.462501:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788664336.462507:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1788664336.462526:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c30480ce00, transno 4294967311 00000100:00100000:1.0:1788664336.462537:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140531328:0@lo:400:kworker.0 00000100:00100000:1.0:1788664336.462561:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140531840:0@lo:400:kworker.0 00000100:00100000:1.0:1788664336.462571:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:3637:1875550140530432:0@lo:400:kworker.0 00000100:00100000:1.0:1788664336.462582:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140530944:0@lo:400:kworker.0 00000100:00100000:1.0:1788664336.462595:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140531456:0@lo:400:kworker.0 00000100:00100000:1.0:1788664336.462645:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140530688:0@lo:400:kworker.0 00000100:00100000:1.0:1788664336.462658:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140531200:0@lo:400:kworker.0 00000100:00100000:1.0:1788664336.462671:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140531712:0@lo:400:kworker.0 00000100:00100000:1.0:1788664336.462683:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140530560:0@lo:400:kworker.0 00010000:00080000:1.0:1788664336.462697:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c422668a80 x1875550140531072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664336.462707:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140531072:0@lo:400:kworker.0 00010000:00080000:1.0:1788664336.462719:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c422668380 x1875550140531584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664336.462727:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140531584:0@lo:400:kworker.0 00000100:00100000:0.0:1788664336.462807:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140531968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664336.462856:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664336.464162:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140531968 00000100:00100000:1.0:1788664336.464173:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140531968 00000100:00100000:1.0:1788664336.464555:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788664336.464567:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875550140531968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664336.464606:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788664336.464685:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875550140531968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664336.464711:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788664336.464801:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140531968:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788664336.834080:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664336.958169:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140532096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664336.958277:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664336.958523:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140532096 00000100:00100000:1.0:1788664336.958534:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140532096 00000100:00100000:1.0:1788664336.958600:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788664336.958610:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140532096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788664336.958640:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788664336.958704:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140532096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664336.958711:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788664336.958859:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140532096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664337.048705:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664337.048761:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664337.048918:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664337.048946:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664337.049016:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119508352 00000100:00100000:2.0:1788664337.049032:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119508352 00000100:00100000:2.0:1788664337.049129:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00100000:2.0:1788664337.049142:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2393:x1875550119508352:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664337.049255:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+8:2393:x1875550119508352:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 115us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664337.049262:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00080000:2.0:1788664337.049422:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664337.049481:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119507840 00000100:00100000:3.0:1788664337.049488:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119507840 00000100:00100000:3.0:1788664337.049597:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 400 00000100:00100000:3.0:1788664337.049628:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2393:x1875550119507840:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664337.049686:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2393:x1875550119507840:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 60us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664337.049693:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 400 00000100:00100000:1.0:1788664337.059812:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664337.066315:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119508096 00000100:00100000:0.0:1788664337.066343:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119508096 00000100:00080000:3.0:1788664337.066470:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788664337.069510:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119508608 00000100:00100000:0.0:1788664337.069530:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119508608 00000100:00100000:0.0:1788664337.069829:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 381 00000100:00100000:0.0:1788664337.069848:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119508096:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664337.069974:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119508096:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 132us (21211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664337.070706:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119507968 00000100:00100000:1.0:1788664337.070719:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119507968 00000100:00100000:3.0:1788664337.072076:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 382 00000100:00100000:3.0:1788664337.072107:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119508608:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664337.072217:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119508608:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 125us (23268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664337.072227:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 382 00000100:00080000:3.0:1788664337.072313:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664337.072320:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788664337.072400:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664337.072448:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664337.072884:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119508480 00000100:00100000:2.0:1788664337.072896:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119508480 00000100:00100000:2.0:1788664337.072961:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 383 00000100:00100000:2.0:1788664337.072971:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119508480:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:3.0:1788664337.073248:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664337.073293:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119508224 00000100:00100000:3.0:1788664337.073298:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119508224 00000100:00100000:3.0:1788664337.073341:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:3.0:1788664337.073349:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119508224:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664337.073393:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2393:x1875550119508224:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 45us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664337.073401:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00080000:3.0:1788664337.073420:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664337.073751:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2393:x1875550119508480:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 58us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664337.073760:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 383 00000100:00100000:0.0:1788664337.078706:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 381 00000100:00100000:1.0:1788664337.084653:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 384 00000100:00100000:1.0:1788664337.084691:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+32:2393:x1875550119507968:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664337.084866:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+32:2393:x1875550119507968:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 195us (25094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664337.084875:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 384 00000100:00100000:2.0:1788664337.470820:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140532224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788664337.470922:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664337.470997:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140532224 00000100:00100000:3.0:1788664337.471007:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140532224 00000100:00100000:3.0:1788664337.471077:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788664337.471103:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304276a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140532224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788664337.471153:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788664337.471228:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304276a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140532224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664337.471236:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788664337.471287:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140532224:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788664337.857602:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664337.983079:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140532352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664337.983154:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664337.983455:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140532352 00000100:00100000:0.0:1788664337.983463:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140532352 00000100:00100000:0.0:1788664337.983514:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788664337.983523:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140532352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664337.983552:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664337.983613:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140532352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664337.983620:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788664337.983665:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140532352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664337.984113:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140532480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664337.984156:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664337.984196:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140532480 00000100:00100000:0.0:1788664337.984201:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140532480 00000100:00100000:0.0:1788664337.984224:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788664337.984231:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140532480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788664337.984244:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664337.984275:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140532480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664337.984281:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788664337.984329:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140532480:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1788664337.985038:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1788664337.985048:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000004:00080000:3.0:1788664337.987183:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:3.0:1788664337.987224:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:3.0:1788664337.987253:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c4068b6f00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788664337.987258:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c303b7cd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c401370780 00000020:00080000:3.0:1788664337.987262:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c303b7ce00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c40820ba00 00000020:00080000:3.0:1788664337.987279:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:2.0:1788664337.987410:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664337.987431:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140532608:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788664337.987502:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664337.987557:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140532608 00000100:00100000:2.0:1788664337.987564:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140532608 00000100:00100000:2.0:1788664337.987625:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788664337.987634:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140532608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788664337.987799:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788664337.987803:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788664330 -> 1788664330 00002000:00010000:2.0:1788664337.987805:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1788664330 -> 1788664330 00002000:00010000:2.0:1788664337.987808:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788664330 -> 1788664330 00002000:00010000:2.0:1788664337.987810:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788664337.987851:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1875550140532608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (348us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788664337.987860:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788664337.987900:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788664337.987906:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788664337.987930:0:3639:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93c304277100 x1875550140532608/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788664353 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788664337.987942:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c304277100/2, rc 0, transno 4294967325 00000100:00100000:2.0:1788664337.987947:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140532608:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788664337.988562:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e75c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664337.988574:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e75c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664337.988593:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e75c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664337.988599:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ac00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664337.988605:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e75c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664337.988614:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e75c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664337.988636:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93c4047be000) 00010000:00010000:1.0:1788664337.988640:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664337.988645:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e75c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664337.988652:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502ac00/0xcd11f61c1413e75c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788664337.988685:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788664337.988736:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1788664338.635085:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664338.635355:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119508736 00000100:00100000:1.0:1788664338.635366:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119508736 00000100:00100000:1.0:1788664338.635443:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 255 00000100:00100000:1.0:1788664338.635453:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:12133:x1875550119508736:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788664338.635570:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:12133:x1875550119508736:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 118us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664338.635578:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 255 00000100:00100000:2.0:1788664338.637825:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664338.638049:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119508864 00000100:00100000:0.0:1788664338.638058:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119508864 00000100:00100000:0.0:1788664338.638170:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 256 00000100:00100000:0.0:1788664338.638181:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:12133:x1875550119508864:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788664338.638291:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:12133:x1875550119508864:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 112us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664338.638298:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 256 00000100:00100000:0.0:1788664338.654974:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664338.655178:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119509120 00000100:00100000:1.0:1788664338.655208:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119509120 00000100:00100000:1.0:1788664338.655268:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:1.0:1788664338.655279:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:12133:x1875550119509120:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788664338.655542:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:12133:x1875550119509120:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 264us (576us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788664338.655550:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00010000:00010000:2.0:1788664338.893394:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664339.110519:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664339.110719:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119509248 00000100:00100000:1.0:1788664339.110732:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119509248 00000100:00100000:1.0:1788664339.110867:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 257 00000100:00100000:1.0:1788664339.110881:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:12937:x1875550119509248:12345-192.168.203.52@tcp:101:lsof.0 00000100:00080000:3.0:1788664339.111124:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788664339.111182:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664339.111214:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e7e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d643 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.111303:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e7ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.111322:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e7ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.111337:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e7ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664339.111418:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788664339.111422:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664339.111450:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e7ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.111478:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85200/0xcd11f61c1413e7e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d643 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.111513:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e7ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d643 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.111524:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c303887300) 00010000:00010000:1.0:1788664339.111527:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788664339.111532:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85c00, rc 0) 00000100:00100000:1.0:1788664339.112153:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:12937:x1875550119509248:12345-192.168.203.52@tcp:101:lsof.0 Request processed in 893us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664339.112163:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 257 00010000:00010000:3.0:1788664339.902796:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664340.926158:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664341.056302:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140532736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664341.056431:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664341.056504:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140532736 00000100:00100000:3.0:1788664341.056516:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140532736 00000100:00100000:3.0:1788664341.056583:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788664341.056594:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140532736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664341.056644:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788664341.056713:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140532736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664341.056723:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788664341.056767:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140532736:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788664341.182096:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788664341.182111:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788664341.182223:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788664341.182231:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788664341.566264:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664341.566308:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140532864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664341.566417:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664341.566668:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140532864 00000100:00100000:3.0:1788664341.566679:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140532864 00000100:00100000:3.0:1788664341.566809:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788664341.566822:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875550140532864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664341.566865:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788664341.566940:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875550140532864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664341.566948:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788664341.567005:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140532864:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788664341.567389:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664341.571757:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140533248:0@lo:400:kworker.0 00000100:00100000:2.0:1788664341.571920:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664341.571984:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140533760:0@lo:400:kworker.0 00000100:00100000:2.0:1788664341.572013:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664341.572033:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140534272:0@lo:400:kworker.0 00000100:00100000:2.0:1788664341.572063:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664341.572092:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788664341.572097:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140533120:0@lo:400:kworker.0 00000100:00100000:2.0:1788664341.572120:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664341.572137:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140533632:0@lo:400:kworker.0 00000100:00100000:2.0:1788664341.572155:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664341.572168:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140534144:0@lo:400:kworker.0 00000100:00100000:2.0:1788664341.572184:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664341.572220:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140533120 00000100:00100000:2.0:1788664341.572230:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140533120 00000100:00100000:2.0:1788664341.572290:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140533632 00000100:00100000:2.0:1788664341.572294:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140533632 00000100:00100000:0.0:1788664341.572304:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140533376:0@lo:400:kworker.0 00000100:00100000:0.0:1788664341.572349:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664341.572379:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140533888:0@lo:400:kworker.0 00000100:00100000:0.0:1788664341.572402:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664341.572422:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788664341.572429:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140532992:0@lo:400:kworker.0 00000100:00100000:2.0:1788664341.572474:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140534144 00000100:00100000:2.0:1788664341.572478:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140534144 00000100:00100000:0.0:1788664341.572484:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664341.572493:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140533376 00000100:00100000:2.0:1788664341.572495:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140533376 00000100:00100000:0.0:1788664341.572506:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140533504:0@lo:400:kworker.0 00000100:00100000:2.0:1788664341.572512:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788664341.572521:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140533120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664341.572526:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664341.572536:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140534016:0@lo:400:kworker.0 00000100:00100000:0.0:1788664341.572554:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664341.572588:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140533504 00000100:00100000:2.0:1788664341.572591:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140533120:12345-0@lo:400:kworker.0 Request processed in 71us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664341.572592:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140533504 00000100:00100000:2.0:1788664341.572600:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788664341.572612:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140534016 00000100:00100000:0.0:1788664341.572614:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140534016 00000100:00100000:2.0:1788664341.572619:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788664341.572624:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140533632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664341.572627:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788664341.572633:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140534144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664341.572654:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140533632:12345-0@lo:400:kworker.0 Request processed in 30us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664341.572659:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140534144:12345-0@lo:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664341.572661:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788664341.572665:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788664341.572672:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788664341.572675:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788664341.572677:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140533376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664341.572680:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140533504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664341.572706:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140533504:12345-0@lo:400:kworker.0 Request processed in 25us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664341.572712:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1788664341.572725:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788664341.572731:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140534016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664341.572752:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140533248 00000100:00100000:1.0:1788664341.572757:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140533248 00000100:00100000:3.0:1788664341.572821:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140533760 00000100:00100000:3.0:1788664341.572826:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140533760 00000100:00100000:3.0:1788664341.572864:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140534272 00000100:00100000:3.0:1788664341.572867:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140534272 00000100:00100000:3.0:1788664341.572883:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140533888 00000100:00100000:3.0:1788664341.572886:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140533888 00000100:00100000:3.0:1788664341.572901:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788664341.572907:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140533760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664341.572944:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140533760:12345-0@lo:400:kworker.0 Request processed in 38us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664341.572951:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788664341.572963:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788664341.572969:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140534272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664341.572995:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140534272:12345-0@lo:400:kworker.0 Request processed in 27us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664341.573000:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788664341.573009:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788664341.573014:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140533888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664341.573124:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788664341.573130:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140533248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664341.573164:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140533248:12345-0@lo:400:kworker.0 Request processed in 35us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664341.573170:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:1.0:1788664341.573201:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664341.573205:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788664341.573216:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788664341.573218:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788664341.573260:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140532992 00000100:00100000:1.0:1788664341.573264:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140532992 00000100:00100000:1.0:1788664341.573310:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1788664341.573319:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140532992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664341.575630:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140533376:12345-0@lo:400:kworker.0 Request processed in 2933us (3261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664341.575654:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788664341.575800:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140533120:0@lo:400:kworker.0 00010000:00080000:2.0:1788664341.575824:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42266a680 x1875550140533632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664341.575840:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140533632:0@lo:400:kworker.0 00010000:00080000:2.0:1788664341.575855:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c422669f80 x1875550140534144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664341.575862:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140534144:0@lo:400:kworker.0 00000100:00100000:2.0:1788664341.575876:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140533248:0@lo:400:kworker.0 00000100:00100000:2.0:1788664341.575890:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140533760:0@lo:400:kworker.0 00000100:00100000:2.0:1788664341.575950:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140534272:0@lo:400:kworker.0 00000100:00100000:0.0:1788664341.579443:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140534016:12345-0@lo:400:kworker.0 Request processed in 6694us (6869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664341.579465:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788664341.580127:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140532992:12345-0@lo:400:kworker.0 Request processed in 6805us (7637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664341.580140:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1788664341.580524:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140532992:0@lo:400:kworker.0 00000100:00100000:0.0:1788664341.580569:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140533504:0@lo:400:kworker.0 00000100:00100000:0.0:1788664341.580596:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140534016:0@lo:400:kworker.0 00000100:00100000:0.0:1788664341.580611:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140533376:0@lo:400:kworker.0 00000100:00100000:3.0:1788664341.593958:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140533888:12345-0@lo:400:kworker.0 Request processed in 20927us (21538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664341.594001:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788664341.595824:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140533888:0@lo:400:kworker.0 00000040:00080000:2.0:1788664341.823336:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788664341.965857:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664342.081093:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140534400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664342.081194:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664342.081340:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140534400 00000100:00100000:1.0:1788664342.081352:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140534400 00000100:00100000:1.0:1788664342.081416:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788664342.081429:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140534400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788664342.081462:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788664342.081526:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140534400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664342.081534:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788664342.081591:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140534400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664342.172167:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664342.172270:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664342.172313:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664342.172352:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664342.172373:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664342.172394:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664342.172421:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664342.172464:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119509888 00000100:00100000:2.0:1788664342.172478:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119509888 00000100:00100000:2.0:1788664342.172547:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119509760 00000100:00100000:2.0:1788664342.172550:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119509760 00000100:00100000:2.0:1788664342.173358:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:2.0:1788664342.173385:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2390:x1875550119509888:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664342.173484:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2390:x1875550119509888:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 109us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664342.173565:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119509632 00000100:00100000:3.0:1788664342.173571:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119509632 00000100:00100000:3.0:1788664342.173623:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119510144 00000100:00100000:3.0:1788664342.173627:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119510144 00000100:00100000:3.0:1788664342.173646:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119509504 00000100:00100000:3.0:1788664342.173649:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119509504 00000100:00100000:3.0:1788664342.173662:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119510016 00000100:00100000:3.0:1788664342.173665:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119510016 00000100:00100000:3.0:1788664342.173680:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 391 00000100:00100000:3.0:1788664342.173688:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119509632:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664342.173719:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119509632:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 33us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664342.173727:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 391 00000100:00100000:3.0:1788664342.173746:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 392 00000100:00100000:3.0:1788664342.173751:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119510144:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664342.173794:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2390:x1875550119510144:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 42us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664342.173801:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 392 00000100:00100000:3.0:1788664342.173815:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 393 00000100:00100000:3.0:1788664342.173821:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:2390:x1875550119509504:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664342.173849:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:2390:x1875550119509504:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664342.173855:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 393 00000100:00100000:3.0:1788664342.173866:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 394 00000100:00100000:3.0:1788664342.173881:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2390:x1875550119510016:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664342.174054:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2390:x1875550119510016:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 171us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664342.174061:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 394 00000100:00100000:1.0:1788664342.175237:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119509376 00000100:00100000:1.0:1788664342.175255:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119509376 00000100:00100000:1.0:1788664342.175341:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 402 00000100:00100000:1.0:1788664342.175353:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119509376:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664342.175419:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119509376:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 69us (3267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664342.175427:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 402 00000100:00100000:0.0:1788664342.176188:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:0.0:1788664342.177341:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119509760:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664342.177377:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:0.0:1788664342.177438:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2390:x1875550119509760:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 129us (5042us total) trans 0 rc 0/0 00000100:00080000:2.0:1788664342.177440:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664342.177448:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788664342.177451:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00080000:2.0:1788664342.177454:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664342.177459:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664342.598865:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664342.598896:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140534528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788664342.598991:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664342.599138:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140534528 00000100:00100000:0.0:1788664342.599148:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140534528 00000100:00100000:0.0:1788664342.599220:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788664342.599232:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140534528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788664342.599282:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788664342.599367:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140534528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664342.599375:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788664342.599427:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140534528:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1788664342.796267:0:14954:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:12:21 (1788664341) 00010000:00010000:3.0:1788664342.977717:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664343.112423:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140534656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664343.112507:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664343.112580:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664343.112587:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140534784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788664343.112621:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664343.112896:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140534656 00000100:00100000:0.0:1788664343.112915:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140534656 00000100:00100000:0.0:1788664343.112978:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140534784 00000100:00100000:0.0:1788664343.112981:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140534784 00000100:00100000:0.0:1788664343.112999:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788664343.113006:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140534656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664343.113036:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664343.113087:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140534656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664343.113093:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788664343.113109:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788664343.113115:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140534784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788664343.113123:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664343.113147:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140534784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664343.113152:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788664343.113196:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140534784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664343.113208:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140534656:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788664343.113439:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788664343.617908:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000020:00080000:3.0:1788664343.617919:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788664343.619026:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788664343.619046:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1788664343.624298:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00010000:00010000:0.0:1788664344.002404:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664345.021949:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664346.053383:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664346.174090:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664346.180465:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140534912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664346.180549:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664346.183140:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140534912 00000100:00100000:3.0:1788664346.183160:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140534912 00000100:00100000:3.0:1788664346.183247:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788664346.183260:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140534912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664346.183310:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788664346.183416:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140534912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 159us (2867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664346.183424:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788664346.183584:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140534912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664346.686553:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140535424:0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.686618:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664346.686674:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140535936:0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.686698:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664346.686714:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140536448:0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.686732:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664346.686754:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788664346.686795:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140535040:0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.686834:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664346.686855:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140535552:0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.686886:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664346.686900:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140536064:0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.686920:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664346.686948:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140535424 00000100:00100000:3.0:1788664346.686955:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140535424 00000100:00100000:3.0:1788664346.686991:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140535552 00000100:00100000:3.0:1788664346.686994:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140535552 00000100:00100000:3.0:1788664346.687017:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140536064 00000100:00100000:3.0:1788664346.687019:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140536064 00000100:00100000:3.0:1788664346.687034:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788664346.687041:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140535424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.687094:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140535424:12345-0@lo:400:kworker.0 Request processed in 52us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664346.687101:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788664346.687118:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788664346.687124:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140535552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.687149:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140535552:12345-0@lo:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664346.687154:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788664346.687164:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788664346.687170:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140536064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.687200:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140536064:12345-0@lo:400:kworker.0 Request processed in 31us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664346.687215:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788664346.687256:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140535552:0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.687266:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140536064:0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.687273:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140535424:0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.687316:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664346.687387:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140535168:0@lo:400:kworker.0 00000100:00100000:0.0:1788664346.687417:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664346.687439:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140535680:0@lo:400:kworker.0 00000100:00100000:0.0:1788664346.687459:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664346.687478:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140536192:0@lo:400:kworker.0 00000100:00100000:0.0:1788664346.687499:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664346.687521:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788664346.687527:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140535296:0@lo:400:kworker.0 00000100:00100000:0.0:1788664346.687552:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664346.687571:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140535808:0@lo:400:kworker.0 00000100:00100000:0.0:1788664346.687590:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664346.687607:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140536320:0@lo:400:kworker.0 00000100:00100000:0.0:1788664346.687623:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664346.687647:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140535168 00000100:00100000:0.0:1788664346.687651:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140535168 00000100:00100000:0.0:1788664346.687670:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140535680 00000100:00100000:0.0:1788664346.687672:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140535680 00000100:00100000:0.0:1788664346.687685:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140536192 00000100:00100000:0.0:1788664346.687687:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140536192 00000100:00100000:0.0:1788664346.687700:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1788664346.688188:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1788664346.688200:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140535680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664346.688251:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140535680:12345-0@lo:400:kworker.0 Request processed in 56us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664346.688258:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1788664346.688274:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1788664346.688280:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140536192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664346.688318:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140536192:12345-0@lo:400:kworker.0 Request processed in 38us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664346.688324:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1788664346.688360:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140535936 00000100:00100000:1.0:1788664346.688365:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140535936 00000100:00100000:1.0:1788664346.688401:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140536448 00000100:00100000:1.0:1788664346.688403:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140536448 00000100:00100000:1.0:1788664346.688414:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140535808 00000100:00100000:1.0:1788664346.688415:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140535808 00000100:00100000:1.0:1788664346.688425:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140536320 00000100:00100000:1.0:1788664346.688427:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140536320 00000100:00100000:1.0:1788664346.688438:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788664346.688444:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140535936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664346.688512:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140535168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664346.688547:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140535168:12345-0@lo:400:kworker.0 Request processed in 840us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664346.688553:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788664346.688574:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788664346.688581:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140536448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664346.691439:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788664346.691456:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788664346.691598:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788664346.691614:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788664346.691628:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140535808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664346.691722:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140535808:12345-0@lo:400:kworker.0 Request processed in 99us (4130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664346.691729:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788664346.691750:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788664346.691756:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788664346.691763:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140536320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664346.692357:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140536320:12345-0@lo:400:kworker.0 Request processed in 593us (4731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664346.692366:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788664346.692453:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140535040 00000100:00100000:2.0:1788664346.692461:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140535040 00000100:00100000:2.0:1788664346.692608:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1788664346.692616:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42b89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140535040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.694761:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304097b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140536576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664346.694780:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140535936:12345-0@lo:400:kworker.0 Request processed in 6321us (8067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664346.694802:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788664346.694867:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140535296 00000100:00100000:1.0:1788664346.694876:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140535296 00000100:00100000:1.0:1788664346.694930:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788664346.694939:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140535296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664346.695038:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140535296:12345-0@lo:400:kworker.0 Request processed in 100us (7484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664346.695044:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788664346.695058:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664346.695101:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140535296:0@lo:400:kworker.0 00000100:00100000:1.0:1788664346.695115:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140535808:0@lo:400:kworker.0 00000100:00100000:1.0:1788664346.695243:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140536320:0@lo:400:kworker.0 00000100:00100000:1.0:1788664346.695261:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140535168:0@lo:400:kworker.0 00010000:00080000:1.0:1788664346.695276:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abea00 x1875550140535680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664346.695286:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140535680:0@lo:400:kworker.0 00010000:00080000:1.0:1788664346.695307:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abdf80 x1875550140536192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664346.695315:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140536192:0@lo:400:kworker.0 00000100:00080000:1.0:1788664346.695366:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664346.695381:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788664346.695385:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788664346.695388:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664346.696382:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140536576 00000100:00100000:1.0:1788664346.696392:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140536576 00000100:00100000:1.0:1788664346.696432:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788664346.696441:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875550140536576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664346.696467:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788664346.696618:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875550140536576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664346.696634:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788664346.697092:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140536448:12345-0@lo:400:kworker.0 Request processed in 8508us (10355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664346.697102:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788664346.700140:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42b89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140535040:12345-0@lo:400:kworker.0 Request processed in 7513us (13293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664346.700173:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1788664346.700274:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140535040:0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.700313:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140535936:0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.700323:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1788664346.700328:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c304277100, transno 4294967325 00000100:00100000:3.0:1788664346.700343:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140536448:0@lo:400:kworker.0 00000100:00100000:3.0:1788664346.700391:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304097b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140536576:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788664347.070030:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664347.088339:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664347.088424:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119510400 00000100:00100000:0.0:1788664347.088434:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119510400 00000100:00100000:0.0:1788664347.088520:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:0.0:1788664347.088531:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+18:13160:x1875550119510400:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:0.0:1788664347.089300:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:13160:x1875550119510400:12345-192.168.203.52@tcp:35:umount.0 Request processed in 760us (960us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788664347.089309:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00080000:1.0:1788664347.089644:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664347.114516:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664347.115011:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119510656 00000100:00100000:3.0:1788664347.115020:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119510656 00000100:00100000:3.0:1788664347.115117:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:3.0:1788664347.115127:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+19:13160:x1875550119510656:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:3.0:1788664347.115410:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:13160:x1875550119510656:12345-192.168.203.52@tcp:35:umount.0 Request processed in 284us (903us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788664347.115417:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:3.0:1788664347.120672:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664347.120842:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119510912 00000100:00100000:2.0:1788664347.120852:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119510912 00000100:00100000:2.0:1788664347.121168:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:2.0:1788664347.121178:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c406b63050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+20:13160:x1875550119510912:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:2.0:1788664347.121454:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c406b63050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:13160:x1875550119510912:12345-192.168.203.52@tcp:35:umount.0 Request processed in 277us (790us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788664347.121462:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:0.0:1788664347.134186:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664347.134426:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119511168 00000100:00100000:2.0:1788664347.134439:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119511168 00000100:00100000:2.0:1788664347.134510:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:2.0:1788664347.134522:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:13160:x1875550119511168:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:2.0:1788664347.141247:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:13160:x1875550119511168:12345-192.168.203.52@tcp:35:umount.0 Request processed in 6710us (7060us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1788664347.141264:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:0.0:1788664347.147132:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664347.147184:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664347.147215:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664347.147243:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664347.147652:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119511808 00000100:00100000:3.0:1788664347.147664:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119511808 00000100:00100000:3.0:1788664347.147737:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119511680 00000100:00100000:3.0:1788664347.147739:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119511680 00000100:00100000:3.0:1788664347.147766:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119511936 00000100:00100000:3.0:1788664347.147804:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119511936 00000100:00100000:3.0:1788664347.147824:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788664347.147835:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+15:2390:x1875550119511808:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664347.147864:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664347.147888:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0c200/0xcd11f61c1413d709 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d157 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664347.147909:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664347.147969:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+14:2390:x1875550119511808:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 136us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664347.147976:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788664347.147995:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788664347.148001:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+13:2390:x1875550119511680:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664347.148008:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664347.148016:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40153b200/0xcd11f61c1413d748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d196 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664347.148026:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664347.148039:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:2390:x1875550119511680:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 39us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664347.148045:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788664347.148055:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:3.0:1788664347.148060:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:2390:x1875550119511936:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664347.148084:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664347.148093:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303956e00/0xcd11f61c1413d9e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d26f expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664347.148111:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664347.148127:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2390:x1875550119511936:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 68us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664347.148133:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:2.0:1788664347.148604:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119511552 00000100:00100000:2.0:1788664347.148610:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119511552 00000100:00100000:2.0:1788664347.148668:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:2.0:1788664347.148675:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+7:2389:x1875550119511552:12345-192.168.203.52@tcp:9:umount.0 00000020:00000080:2.0:1788664347.148707:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413dd5a 00000020:00010000:2.0:1788664347.148715:0:8426:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93c3041b1000: total 0 00000100:00080000:2.0:1788664347.148720:0:8426:0:(import.c:65:import_set_state_nolock()) ffff93c3041b3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788664347.148795:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788664347.148956:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2389:x1875550119511552:12345-192.168.203.52@tcp:9:umount.0 Request processed in 281us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664347.148977:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000020:00010000:2.0:1788664347.148998:0:6499:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93c3041b1000: total 0 00010000:00010000:2.0:1788664347.149019:0:6499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93c3041b1000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788664347.149073:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5029147/0xcd11f61c1413e112 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d459 expref: 4 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664347.149508:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090af938b/0xcd11f61c1413e7e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d63c expref: 3 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664347.149530:0:6499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93c3041b1000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788664347.149601:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664347.149604:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664347.149606:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788664347.150678:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664347.162166:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664347.162342:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119512064 00000100:00100000:1.0:1788664347.162356:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119512064 00000100:00100000:1.0:1788664347.162455:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:1.0:1788664347.162467:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2389:x1875550119512064:12345-192.168.203.52@tcp:9:umount.0 00000020:00000080:1.0:1788664347.162508:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413dae4 00000100:00080000:1.0:1788664347.162520:0:8429:0:(import.c:65:import_set_state_nolock()) ffff93c40392f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788664347.162713:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788664347.162989:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07edea8-5696-4cd5-9a12-cefd3a8358e9+2:2389:x1875550119512064:12345-192.168.203.52@tcp:9:umount.0 Request processed in 522us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664347.162998:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00080000:3.0:1788664347.163871:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788664347.166385:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664347.180888:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664347.181106:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119513088 00000100:00100000:1.0:1788664347.181120:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119513088 00000100:00100000:1.0:1788664347.181219:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 258 00000100:00100000:1.0:1788664347.181233:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+22:2389:x1875550119513088:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:1.0:1788664347.181428:0:6511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d717 00000020:00010000:1.0:1788664347.181451:0:6511:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93c43f7ce000: total 0 00000100:00080000:1.0:1788664347.181457:0:6511:0:(import.c:65:import_set_state_nolock()) ffff93c43f7c9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788664347.181494:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00010000:0.0:1788664347.181635:0:6500:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93c43f7ce000: total 0 00010000:00010000:0.0:1788664347.181708:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93c43f7ce000, canceled 0 locks, left on hash table 13. 00000100:00100000:1.0:1788664347.183910:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07edea8-5696-4cd5-9a12-cefd3a8358e9+21:2389:x1875550119513088:12345-192.168.203.52@tcp:39:umount.0 Request processed in 2667us (3026us total) trans 4294967529 rc 0/0 00000100:00100000:1.0:1788664347.183929:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 258 00010000:00010000:0.0:1788664347.185728:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c3027e5a00) 00010000:00010000:0.0:1788664347.185870:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664347.185882:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413da43 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d27d expref: 20 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664347.185944:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:0.0:1788664347.185948:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788664347.185953:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956200/0xcd11f61c1413e197 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d47c expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664347.185971:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:0.0:1788664347.185973:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664347.185977:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d200/0xcd11f61c1413dff3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d40c expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664347.186011:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:0.0:1788664347.186014:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788664347.186018:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351eec00/0xcd11f61c1413daba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d299 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664347.186031:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93c3027e5500) 00010000:00010000:0.0:1788664347.186033:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788664347.186036:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502b800/0xcd11f61c1413e484 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d555 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664347.186051:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:0.0:1788664347.186053:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664347.186056:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303957200/0xcd11f61c1413e7a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d627 expref: 15 pid: 9169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664347.186067:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:0.0:1788664347.186069:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788664347.186072:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c40502a000/0xcd11f61c1413e7cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d635 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664347.186081:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:0.0:1788664347.186083:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664347.186086:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413e0d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d444 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664347.186095:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93c4350d0900) 00010000:00010000:0.0:1788664347.186097:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788664347.186107:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85600/0xcd11f61c1413e0fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d452 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664347.186136:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c303887300) 00010000:00010000:0.0:1788664347.186139:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664347.186142:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956000/0xcd11f61c1413e17b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d475 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664347.186313:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c4350d6600) 00010000:00010000:0.0:1788664347.186316:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664347.186321:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c4351ee200/0xcd11f61c1413da5f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d284 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664347.186336:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93c3038d3900) 00010000:00010000:0.0:1788664347.186339:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664347.186343:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303956600/0xcd11f61c1413e6c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d5ef expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664347.186357:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93c4350d0000) 00010000:00010000:0.0:1788664347.186360:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788664347.186363:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413ddb5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d372 expref: 8 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664347.186375:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93c43f7ce000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788664347.186409:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664347.186412:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664347.186415:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664347.195318:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664347.195528:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119513216 00000100:00100000:1.0:1788664347.195541:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119513216 00000100:00100000:1.0:1788664347.195763:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 259 00000100:00100000:1.0:1788664347.195819:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+5:2389:x1875550119513216:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:1.0:1788664347.195894:0:9524:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d71e 00000100:00080000:1.0:1788664347.195913:0:9524:0:(import.c:65:import_set_state_nolock()) ffff93c302b95800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788664347.195943:0:9524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788664347.196171:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b07edea8-5696-4cd5-9a12-cefd3a8358e9+3:2389:x1875550119513216:12345-192.168.203.52@tcp:39:umount.0 Request processed in 397us (876us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788664347.196180:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 259 00000100:00080000:3.0:1788664347.196318:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788664347.196961:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664347.210606:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664347.210639:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140536704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664347.210733:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664347.211099:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140536704 00000100:00100000:3.0:1788664347.211110:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140536704 00000100:00100000:3.0:1788664347.211181:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788664347.211193:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140536704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788664347.211226:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788664347.211460:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140536704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 266us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664347.211471:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788664347.211579:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140536704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788664347.293550:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664347.293608:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664347.293823:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119513344 00000100:00100000:0.0:1788664347.293836:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119513344 00000100:00100000:0.0:1788664347.293959:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119513472 00000100:00100000:0.0:1788664347.293962:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119513472 00000100:00100000:0.0:1788664347.293996:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 401 00000100:00100000:0.0:1788664347.294007:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2392:x1875550119513344:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664347.294106:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2392:x1875550119513344:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 100us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664347.294115:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 401 00000100:00100000:0.0:1788664347.294134:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 402 00000100:00100000:0.0:1788664347.294140:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2392:x1875550119513472:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664347.294183:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2392:x1875550119513472:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 43us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664347.294189:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 402 00000100:00080000:3.0:1788664347.296658:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788664347.296672:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664347.710361:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664347.710734:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140536832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664347.710884:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664347.721519:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140536832 00000100:00100000:0.0:1788664347.721544:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140536832 00000100:00100000:0.0:1788664347.721643:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788664347.721657:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140536832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788664347.721714:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788664347.721871:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140536832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 217us (10987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664347.721879:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788664347.725618:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140536832:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788664348.094153:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664348.222329:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788664348.222364:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140536960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664348.223742:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664348.223819:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304097b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140537088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788664348.226958:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664348.227433:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140537088 00000100:00100000:0.0:1788664348.227444:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140537088 00000100:00100000:0.0:1788664348.227566:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788664348.227578:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140537088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788664348.227630:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788664348.227725:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140537088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664348.227732:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:1.0:1788664348.227913:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664348.227977:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304097b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140537088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664348.230669:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664348.232745:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140536960 00000100:00100000:1.0:1788664348.232760:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140536960 00000100:00100000:1.0:1788664348.233131:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788664348.233142:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140536960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664348.233171:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788664348.233270:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140536960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (2605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664348.233277:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788664348.234398:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140536960:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788664348.234662:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788664349.118253:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664349.420220:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664349.420319:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664349.420435:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664349.420469:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119513600 00000100:00100000:3.0:1788664349.420478:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119513600 00000100:00100000:3.0:1788664349.420531:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119513728 00000100:00100000:3.0:1788664349.420534:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119513728 00000100:00100000:3.0:1788664349.420551:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119513856 00000100:00100000:3.0:1788664349.420554:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119513856 00000100:00100000:3.0:1788664349.420570:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:3.0:1788664349.420579:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+12:2391:x1875550119513600:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664349.420594:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664349.420616:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4351eea00/0xcd11f61c1413d81a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1ab expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664349.420634:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664349.420681:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+11:2391:x1875550119513600:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 103us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664349.420689:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:3.0:1788664349.420706:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:3.0:1788664349.420712:0:10332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+10:2392:x1875550119513728:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664349.420720:0:10332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664349.420730:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303957c00/0xcd11f61c1413d821 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d1dc expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664349.420740:0:10332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664349.420760:0:10332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+9:2392:x1875550119513728:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 48us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664349.420766:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:1.0:1788664349.428875:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1788664349.428904:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+8:2392:x1875550119513856:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664349.428927:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664349.428966:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303b85400/0xcd11f61c1413d9da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d268 expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664349.428985:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664349.429042:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+7:2392:x1875550119513856:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 153us (8606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664349.429051:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1788664349.434305:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664349.434341:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119514112 00000100:00100000:1.0:1788664349.434350:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119514112 00000100:00100000:1.0:1788664349.434417:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 260 00000100:00100000:1.0:1788664349.434428:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+6:2389:x1875550119514112:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:1.0:1788664349.434472:0:9524:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d82f 00000020:00010000:1.0:1788664349.434480:0:9524:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93c4352e4000: total 0 00000100:00080000:1.0:1788664349.434485:0:9524:0:(import.c:65:import_set_state_nolock()) ffff93c4352e2000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788664349.434513:0:9524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00100000:1.0:1788664349.434790:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2389:x1875550119514112:12345-192.168.203.52@tcp:39:umount.0 Request processed in 363us (493us total) trans 4294967530 rc 0/0 00000100:00100000:1.0:1788664349.434798:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 260 00000100:00080000:1.0:1788664349.434961:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1788664349.435068:0:6499:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93c4352e4000: total 0 00010000:00010000:1.0:1788664349.435072:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664349.435336:0:6499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93c4352e4000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788664349.435371:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c303887300) 00010000:00010000:1.0:1788664349.435375:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788664349.435384:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85c00/0xcd11f61c1413e7ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d643 expref: 4 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664349.435406:0:6499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93c4352e4000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788664349.435432:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664349.435434:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664349.435436:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664349.440543:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664349.440619:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119514240 00000100:00100000:0.0:1788664349.440630:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119514240 00000100:00100000:0.0:1788664349.440761:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 261 00000100:00100000:0.0:1788664349.440821:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+5:2389:x1875550119514240:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:0.0:1788664349.440997:0:9169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d836 00000100:00080000:0.0:1788664349.441007:0:9169:0:(import.c:65:import_set_state_nolock()) ffff93c4352e2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788664349.441039:0:9169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1788664349.441172:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664349.441381:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc+3:2389:x1875550119514240:12345-192.168.203.52@tcp:39:umount.0 Request processed in 609us (847us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788664349.441390:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 261 00000100:00080000:1.0:1788664349.446462:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788664349.465583:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664349.465742:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119514496 00000100:00100000:2.0:1788664349.465753:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119514496 00000100:00100000:2.0:1788664349.466008:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 404 00000100:00100000:2.0:1788664349.466020:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42da6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+7:2389:x1875550119514496:12345-192.168.203.52@tcp:251:umount.0 00000020:00000080:2.0:1788664349.466096:0:6505:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d6f4 00000020:00010000:2.0:1788664349.466104:0:6505:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93c303737800: total 0 00000100:00080000:2.0:1788664349.466109:0:6505:0:(import.c:65:import_set_state_nolock()) ffff93c303735800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788664349.466181:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42da6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e13f63f-6cb4-4650-b0b3-d6df6f89c262+3:2389:x1875550119514496:12345-192.168.203.52@tcp:251:umount.0 Request processed in 163us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664349.466190:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 404 00000020:00010000:0.0:1788664349.467079:0:6500:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93c303737800: total 0 00010000:00010000:0.0:1788664349.467147:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93c303737800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788664349.467184:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e3a00/0xcd11f61c1413d74f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d19d expref: 2 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664349.467217:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93c303737800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788664349.467229:0:6500:0:(genops.c:885:class_export_put()) final put ffff93c303737800/2e13f63f-6cb4-4650-b0b3-d6df6f89c262 00010000:00010000:0.0:1788664349.467248:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664349.467251:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664349.467252:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788664349.468474:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c303737800/2e13f63f-6cb4-4650-b0b3-d6df6f89c262 for MGS 00000020:00000080:3.0:1788664349.468545:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c303735800 for MGS 00010000:00010000:1.0:1788664350.141914:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788664351.040928:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788664351.166175:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664351.295325:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788664351.295350:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f8ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140537216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664351.295469:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664351.295556:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140537216 00000100:00100000:0.0:1788664351.295563:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140537216 00000100:00100000:0.0:1788664351.295606:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788664351.295614:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140537216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788664351.295651:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788664351.295718:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140537216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664351.295725:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788664351.295806:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f8ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140537216:0@lo:41:osp-pre-1-0.0 00000020:01000004:0.0:1788664351.390444:0:15151:0:(tgt_mount.c:2197:server_umount_begin()) umount -f 00000020:01000004:2.0:1788664351.408023:0:15151:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788664351.408081:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664351.408094:0:15151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d7e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664351.408102:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d7e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664351.408109:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d7e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664351.408221:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788664351.408227:0:15151:0:(mgc_request.c:545:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788664351.408258:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788664351.408271:0:15151:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788664351.408278:0:15151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788664351.408300:0:15151:0:(import.c:65:import_set_state_nolock()) ffff93c406b9b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788664351.408591:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664351.408600:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d7e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.408609:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0de00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1788664351.408613:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d7e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.408622:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d7e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664351.408629:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d7e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664351.408635:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788664351.408638:0:6500:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788664351.408641:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788664351.408665:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d7e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.408671:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788664351.408727:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140537472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664351.408826:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664351.408917:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d7e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.408925:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c402a0de00/0xcd11f61c1413d7e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d7e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.408937:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664351.409010:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664351.409018:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664351.409587:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875550140537344:0@lo:39:umount.0 00000100:00100000:1.0:1788664351.409636:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664351.409693:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140537472 00000100:00100000:1.0:1788664351.409700:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140537472 00000100:00100000:1.0:1788664351.409759:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788664351.409880:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140537344 00000100:00100000:2.0:1788664351.409885:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140537344 00000100:00100000:2.0:1788664351.409925:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788664351.409932:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875550140537344:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788664351.409958:0:6513:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d319 00000100:00080000:2.0:1788664351.409966:0:6513:0:(import.c:65:import_set_state_nolock()) ffff93c42e87e800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788664351.410032:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3635:x1875550140537344:12345-0@lo:39:umount.0 Request processed in 101us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664351.410039:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1788664351.410049:0:6513:0:(genops.c:885:class_export_put()) final put ffff93c42e87d000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788664351.410105:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664351.410109:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+24:3639:x1875550140537472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788664351.410122:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664351.410138:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4351ef600/0xcd11f61c1413d7e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d7e2 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664351.410151:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664351.410183:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+23:3639:x1875550140537472:12345-0@lo:103:ldlm_bl.0 Request processed in 416us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664351.410189:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788664351.410221:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c406b9b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788664351.410242:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875550140537344:0@lo:39:umount.0 00000100:00080000:3.0:1788664351.410294:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788664351.410298:0:15151:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788664351.410303:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1788664351.410480:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140537472:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788664351.410594:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42e87d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788664351.410721:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c42e87e800 for lustre-MDT0000 00010000:00010000:3.0:1788664351.411220:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411233:0:15151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d7f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411240:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d7f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411247:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d7f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411280:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664351.411287:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d6b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411295:0:15151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d6b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411301:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d6b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664351.411306:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664351.411308:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d6b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664351.411314:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d7f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411323:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788664351.411324:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40153b800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664351.411329:0:7453:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d7f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664351.411341:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d7f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411344:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664351.411352:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d6b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664351.411353:0:7453:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d7f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411368:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ef200 already unused, calling callback (ffffffffc1230c20) 10000000:01000000:2.0:1788664351.411369:0:7453:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:3.0:1788664351.411372:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d6b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664351.411374:0:7453:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788664351.411381:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d6b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664351.411389:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d6b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664351.411394:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788664351.411396:0:6500:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788664351.411399:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788664351.411406:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d7f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664351.411414:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788664351.411418:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d6b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411425:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664351.411435:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d7f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411437:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d6b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664351.411453:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c40153b800/0xcd11f61c1413d7f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d7f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411454:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4351ef200/0xcd11f61c1413d6ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d6b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411477:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664351.411480:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664351.411480:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664351.411486:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664351.411486:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664351.411491:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664351.411500:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413da19 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664351.411507:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140537600:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788664351.411517:0:15151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413da19 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411525:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413da19 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411531:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413da19 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411544:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664351.411552:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664351.411557:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413da19 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411564:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351ee400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1788664351.411567:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413da19 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411574:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413da19 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664351.411584:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413da19 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664351.411590:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788664351.411592:0:6499:0:(mgc_request.c:942:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788664351.411594:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788664351.411609:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413da19 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411627:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788664351.411628:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664351.411647:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413da19 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411654:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4351ee400/0xcd11f61c1413da12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413da19 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.411664:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664351.411666:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664351.411669:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664351.411678:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664351.411679:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140537856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664351.411689:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140537728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788664351.411716:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664351.411736:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140537600 00000100:00100000:2.0:1788664351.411741:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140537600 00000100:00100000:3.0:1788664351.411760:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140537856 00000100:00100000:3.0:1788664351.411766:0:10332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140537856 00000100:00100000:2.0:1788664351.411872:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788664351.411881:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+24:3636:x1875550140537600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664351.411892:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664351.411905:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40153a800/0xcd11f61c1413d7f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d7f0 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664351.411918:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664351.411946:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+23:3636:x1875550140537600:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664351.411952:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788664351.411972:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788664351.411977:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+22:3638:x1875550140537856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664351.411985:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664351.411994:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413da19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413da12 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664351.412003:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664351.412033:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a681e771-e9ab-478d-af58-39fce2e20de6+21:3638:x1875550140537856:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (318us total) trans 0 rc 0/0 00010000:00010000:3.0:1788664351.412037:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153aa00/0xcd11f61c1413d26a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d271 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664351.412041:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1788664351.412051:0:15151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153aa00/0xcd11f61c1413d26a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d271 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.412057:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153aa00/0xcd11f61c1413d26a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d271 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.412065:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c40153aa00/0xcd11f61c1413d26a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d271 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.412079:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788664351.412082:0:15151:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788664351.412086:0:15151:0:(mgc_request.c:545:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:2.0:1788664351.412097:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140537856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664351.412122:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664351.412126:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664351.412131:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c40153aa00/0xcd11f61c1413d26a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d271 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.412139:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40153aa00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1788664351.412142:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c40153aa00/0xcd11f61c1413d26a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d271 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664351.412148:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140537600:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788664351.412152:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c40153aa00/0xcd11f61c1413d26a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d271 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664351.412160:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c40153aa00/0xcd11f61c1413d26a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d271 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664351.412166:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000100:00100000:2.0:1788664351.412167:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140537728 10000000:01000000:3.0:1788664351.412170:0:6500:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788664351.412173:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1788664351.412173:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140537728 00010000:00010000:3.0:1788664351.412193:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c40153aa00/0xcd11f61c1413d26a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d271 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.412200:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788664351.412204:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788664351.412212:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+21:3636:x1875550140537728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788664351.412217:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c40153aa00/0xcd11f61c1413d26a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d271 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664351.412219:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664351.412230:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c40153aa00/0xcd11f61c1413d26a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d271 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664351.412232:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0d800/0xcd11f61c1413d6b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d6ae expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664351.412247:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664351.412250:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664351.412251:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664351.412255:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788664351.412277:0:15151:0:(tgt_mount.c:2117:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788664351.412282:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788664351.412291:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000100:00100000:2.0:1788664351.412294:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a681e771-e9ab-478d-af58-39fce2e20de6+20:3636:x1875550140537728:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (170us total) trans 0 rc 0/0 00000020:00000080:3.0:1788664351.412298:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000100:00100000:2.0:1788664351.412303:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:00080000:3.0:1788664351.412306:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93c3029f9000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788664351.412314:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93c302568000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788664351.412319:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93c42f78c000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788664351.412324:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93c42f76f800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000100:00100000:2.0:1788664351.412328:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140537984:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788664351.412334:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff93c4352e4000 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc 192.168.203.52@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788664351.412341:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff93c43f7ce000 b07edea8-5696-4cd5-9a12-cefd3a8358e9 192.168.203.52@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967524 stale:0 00000020:00080000:3.0:1788664351.412347:0:15151:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff93c422740000) has exports, disconnecting them 00000020:00080000:3.0:1788664351.412352:0:15151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93c3029f9000), last request at 1788664346 00000020:00000080:3.0:1788664351.412359:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d61b 00000100:00100000:2.0:1788664351.412365:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788664351.412375:0:15151:0:(import.c:65:import_set_state_nolock()) ffff93c3029fb800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788664351.412414:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140537984 00000100:00100000:2.0:1788664351.412418:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140537984 00000100:00100000:2.0:1788664351.412446:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788664351.412455:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304097480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+20:3639:x1875550140537984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664351.412463:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664351.412474:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0dc00/0xcd11f61c1413d271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d26a expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664351.412484:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664351.412955:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304097480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a681e771-e9ab-478d-af58-39fce2e20de6+19:3639:x1875550140537984:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664351.412962:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788664351.412993:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:3639:1875550140537984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664351.413013:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140537728:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788664351.413657:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c3029f9000): rc 0 00000020:00000080:3.0:1788664351.413661:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c3029f9000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788664351.413682:0:15151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93c302568000), last request at 1788664346 00000020:00000080:3.0:1788664351.413688:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d4f5 00000020:00000080:1.0:1788664351.413691:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c3029f9000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:3.0:1788664351.413697:0:15151:0:(import.c:65:import_set_state_nolock()) ffff93c30256f800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788664351.413722:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788664351.413731:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c302568000): rc 0 00000020:00000080:3.0:1788664351.413733:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c302568000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788664351.413740:0:15151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93c42f78c000), last request at 1788664096 00000020:00000080:3.0:1788664351.413743:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d3f2 00000020:00000080:1.0:1788664351.413745:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c3029fb800 for lustre-MDT0000 00000100:00080000:3.0:1788664351.413747:0:15151:0:(import.c:65:import_set_state_nolock()) ffff93c42f78e800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788664351.413757:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788664351.413766:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c42f78c000): rc 0 00000020:00000080:3.0:1788664351.413784:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c42f78c000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788664351.413797:0:15151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93c42f76f800), last request at 1788664096 00000020:00000080:3.0:1788664351.413801:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d3c1 00000100:00080000:3.0:1788664351.413805:0:15151:0:(import.c:65:import_set_state_nolock()) ffff93c42f768800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788664351.413821:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788664351.413828:0:15151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967530 00000020:00000080:1.0:1788664351.413849:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c302568000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788664351.413876:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42f78c000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00080000:3.0:1788664351.413900:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c42f76f800): rc 0 00000004:00000080:3.0:1788664351.413907:0:15151:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaa6d416c7ae8 00000100:00080000:3.0:1788664351.413925:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788664351.413928:0:15151:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000020:00000080:1.0:1788664351.413956:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c30256f800 for lustre-MDT0000 00000020:00000080:1.0:1788664351.413961:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c42f78e800 for lustre-MDT0000 00000100:00080000:3.0:1788664351.414702:0:15151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788664351.414727:0:15151:0:(import.c:65:import_set_state_nolock()) ffff93c430605800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788664351.414893:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788664351.414897:0:15151:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1788664351.414911:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788664351.414981:0:15151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788664351.414991:0:15151:0:(import.c:65:import_set_state_nolock()) ffff93c30291e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788664351.414998:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788664351.415000:0:15151:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1788664351.415010:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788664351.415068:0:15151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788664351.415076:0:15151:0:(import.c:65:import_set_state_nolock()) ffff93c303730000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788664351.415134:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93c422740000) has no exports 00000100:00100000:1.0:1788664351.415600:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140538112:0@lo:39:umount.0 00000100:00100000:1.0:1788664351.415672:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664351.415708:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140538240:0@lo:9:umount.0 00000100:00100000:1.0:1788664351.415735:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664351.415756:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140538368:0@lo:9:umount.0 00000100:00100000:1.0:1788664351.415876:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664351.415960:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140538112 00000100:00100000:1.0:1788664351.415967:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140538112 00000100:00100000:1.0:1788664351.416012:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788664351.416020:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875550140538112:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788664351.416048:0:6516:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d45b 00000100:00080000:1.0:1788664351.416058:0:6516:0:(import.c:65:import_set_state_nolock()) ffff93c42f76e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788664351.416080:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788664351.416211:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3635:x1875550140538112:12345-0@lo:39:umount.0 Request processed in 191us (538us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788664351.416220:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788664351.416248:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140538240 00000100:00100000:1.0:1788664351.416252:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140538240 00000100:00100000:1.0:1788664351.416298:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140538368 00000100:00100000:1.0:1788664351.416301:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140538368 00000100:00100000:1.0:1788664351.416323:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788664351.416330:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875550140538240:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788664351.416346:0:8428:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d59d 00000100:00080000:1.0:1788664351.416360:0:8428:0:(import.c:65:import_set_state_nolock()) ffff93c302982000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788664351.416395:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788664351.416480:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3635:x1875550140538240:12345-0@lo:9:umount.0 Request processed in 151us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664351.416488:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788664351.416499:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788664351.416506:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422669500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875550140538368:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788664351.416600:0:8428:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d6df 00000100:00080000:1.0:1788664351.416607:0:8428:0:(import.c:65:import_set_state_nolock()) ffff93c302983000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788664351.416625:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788664351.416698:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422669500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3635:x1875550140538368:12345-0@lo:9:umount.0 Request processed in 193us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664351.416704:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:1.0:1788664351.416725:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788664351.416731:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664351.416735:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788664351.416740:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788664351.416863:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c430605800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788664351.416871:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140538112:0@lo:39:umount.0 00000100:00080000:1.0:1788664351.416885:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c30291e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788664351.416896:0:3635:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788664351.416898:0:3635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788664351.416901:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140538240:0@lo:9:umount.0 00000100:00080000:1.0:1788664351.416912:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c303730000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788664351.416916:0:3635:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788664351.416917:0:3635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788664351.416919:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140538368:0@lo:9:umount.0 00010000:00010000:0.0:1788664351.419747:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788664351.422466:0:13796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664351.422476:0:13796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664351.422568:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788664351.422575:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:00080000:3.0:1788664351.438200:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93c422740000) has no exports 00000020:00000080:3.0:1788664351.499716:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d2c5 00000020:00000080:3.0:1788664351.499732:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c42e8c6000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788664351.499839:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788664351.499920:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42e8c6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788664351.499948:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788664351.499958:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788664351.499963:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff93c42e863380) has no exports 00000020:00000080:0.0:1788664351.500341:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d2be 00000020:00000080:0.0:1788664351.500346:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c42e85c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788664351.500403:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42e85c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788664351.500461:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788664351.500467:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788664351.500470:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c42e85e000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788664351.500473:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42e85e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788664351.500476:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:3.0:1788664351.806137:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e88a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140538496:0@lo:400:kworker.0 00000100:00100000:2.0:1788664351.806137:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140538624:0@lo:400:kworker.0 00000100:00100000:1.0:1788664351.806237:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140538752:0@lo:400:kworker.0 00000100:00100000:0.0:1788664351.812319:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140538880:0@lo:400:kworker.0 00000100:00100000:2.0:1788664351.815910:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664351.815976:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140539136:0@lo:400:kworker.0 00000100:00100000:2.0:1788664351.816030:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664351.816090:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140538624 00000100:00100000:2.0:1788664351.816097:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140538624 00000100:00100000:2.0:1788664351.816161:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140539136 00000100:00100000:2.0:1788664351.816164:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140539136 00000100:00100000:2.0:1788664351.816224:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788664351.816232:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875550140538624:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788664351.816239:0:6511:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788664351.816306:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875550140538624:12345-0@lo:400:kworker.0 Request processed in 73us (402us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788664351.816313:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788664351.816330:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788664351.816334:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875550140539136:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788664351.816338:0:6511:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788664351.816361:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875550140539136:12345-0@lo:400:kworker.0 Request processed in 25us (330us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788664351.816366:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1788664351.816408:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788664351.816413:0:3637:0:(import.c:65:import_set_state_nolock()) ffff93c42f788800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788664351.816416:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788664351.820028:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664351.820101:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140539008:0@lo:400:kworker.0 00000100:00100000:3.0:1788664351.820141:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664351.820310:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140539008 00000100:00100000:3.0:1788664351.820319:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140539008 00000100:00100000:3.0:1788664351.820372:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788664351.820381:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140539008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664351.820437:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140539008:12345-0@lo:400:kworker.0 Request processed in 58us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664351.820444:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:3.0:1788664351.820468:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664351.820500:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140539008:0@lo:400:kworker.0 00000100:00100000:3.0:1788664351.820536:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140538496 00000100:00100000:3.0:1788664351.820540:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140538496 00000100:00100000:3.0:1788664351.820563:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788664351.820568:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1875550140538496:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788664351.820573:0:7860:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788664351.820621:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1875550140538496:12345-0@lo:400:kworker.0 Request processed in 52us (602us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788664351.820627:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:3.0:1788664351.820653:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788664351.820658:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93c42f5f5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788664351.820662:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788664351.820668:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93c42f5f5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788664351.820673:0:3636:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 191 00000100:00080000:3.0:1788664351.820678:0:3636:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93c42f5f5000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788664351.820704:0:3636:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c303abf480 x1875550140539520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788664351.820733:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e88a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140538496:0@lo:400:kworker.0 00000100:00100000:3.0:1788664351.820764:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140539520:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788664351.821393:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664351.821435:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140539520 00000100:00100000:3.0:1788664351.821439:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140539520 00000100:00100000:3.0:1788664351.821459:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788664351.821465:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1875550140539520:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788664351.821481:0:6516:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788664351.824792:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664351.824883:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140539264:0@lo:400:kworker.0 00000100:00100000:1.0:1788664351.824921:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664351.824992:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140538752 00000100:00100000:1.0:1788664351.825000:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140538752 00000100:00100000:1.0:1788664351.825040:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140539264 00000100:00100000:1.0:1788664351.825043:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140539264 00000100:00100000:1.0:1788664351.825080:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1788664351.825090:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140539264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664351.825152:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140539264:12345-0@lo:400:kworker.0 Request processed in 65us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664351.825160:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1788664351.825178:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788664351.825181:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1875550140538752:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788664351.825186:0:6511:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788664351.825211:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1875550140538752:12345-0@lo:400:kworker.0 Request processed in 29us (443us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788664351.825216:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1788664351.825248:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788664351.825252:0:3638:0:(import.c:65:import_set_state_nolock()) ffff93c30257d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788664351.825256:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788664351.825274:0:3638:0:(import.c:65:import_set_state_nolock()) ffff93c30257d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788664351.825279:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 212 00000100:00080000:1.0:1788664351.825285:0:3638:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93c30257d800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788664351.825312:0:3638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c422669f80 x1875550140539648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788664351.825356:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140538752:0@lo:400:kworker.0 00010000:00080000:1.0:1788664351.825372:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039caa00 x1875550140539264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664351.825383:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140539264:0@lo:400:kworker.0 00000100:00080000:1.0:1788664351.825420:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788664351.825453:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1875550140539648:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788664351.825599:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664351.825639:0:9169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140539648 00000100:00100000:1.0:1788664351.825643:0:9169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140539648 00000100:00100000:1.0:1788664351.825663:0:9169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788664351.825667:0:9169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1875550140539648:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788664351.825685:0:9169:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788664351.825718:0:9169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1875550140539648:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 49us (119us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788664351.825724:0:9169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1788664351.825749:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c30257d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788664351.825753:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788664351.825756:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1875550140539648:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1788664351.830413:0:3637:0:(import.c:65:import_set_state_nolock()) ffff93c42f788800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664351.830425:0:3637:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 191 00000100:00080000:2.0:1788664351.830434:0:3637:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93c42f788800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788664351.830452:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664351.830474:0:3637:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039ca300 x1875550140539776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664351.830504:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140538624:0@lo:400:kworker.0 00000100:00100000:0.0:1788664351.830506:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140539392:0@lo:400:kworker.0 00000100:00100000:2.0:1788664351.830524:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875550140539776:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788664351.830541:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664351.830553:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664351.830585:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140538880 00000100:00100000:2.0:1788664351.830591:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140539392 00000100:00100000:1.0:1788664351.830595:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140538880 00000100:00100000:2.0:1788664351.830597:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140539392 00000100:00100000:0.0:1788664351.830600:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140539776 00000100:00100000:0.0:1788664351.830605:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140539776 00000100:00100000:0.0:1788664351.830646:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1788664351.830658:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788664351.830666:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788664351.830667:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140539392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664351.830667:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140538880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664351.830676:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1875550140539776:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788664351.830698:0:6513:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788664351.830727:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140539392:12345-0@lo:400:kworker.0 Request processed in 63us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664351.830729:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140538880:12345-0@lo:400:kworker.0 Request processed in 71us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664351.830736:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788664351.830736:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1788664351.830753:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1875550140539776:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 76us (198us total) trans 0 rc -19/-19 00010000:00080000:0.0:1788664351.830799:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039cad80 x1875550140538880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664351.830812:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140538880:0@lo:400:kworker.0 00000100:00100000:1.0:1788664351.830859:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1788664351.830879:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664351.830883:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788664351.832383:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c42f788800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664351.832392:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788664351.832396:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875550140539776:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1788664351.832436:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788664351.832441:0:3637:0:(import.c:65:import_set_state_nolock()) ffff93c43675a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788664351.832444:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788664351.832449:0:3637:0:(import.c:65:import_set_state_nolock()) ffff93c43675a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664351.832453:0:3637:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 235 00000100:00080000:2.0:1788664351.832459:0:3637:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93c43675a800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664351.832488:0:3637:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039ca300 x1875550140539904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664351.832684:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140539136:0@lo:400:kworker.0 00000100:00100000:2.0:1788664351.832718:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1875550140539904:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788664351.832768:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664351.832836:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140539904 00000100:00100000:2.0:1788664351.832842:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140539904 00000100:00100000:2.0:1788664351.832872:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788664351.832879:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1875550140539904:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788664351.832894:0:6511:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788664351.832943:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1875550140539904:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 63us (174us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788664351.832950:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1788664351.832977:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c43675a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664351.832980:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788664351.832983:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1875550140539904:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788664351.837629:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140539392:0@lo:400:kworker.0 00000100:00100000:3.0:1788664351.850497:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1875550140539520:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 29021us (29094us total) trans 0 rc -19/-19 00000100:00080000:2.0:1788664351.852436:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c42f5f5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664351.852448:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788664351.852453:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140539520:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788664351.854043:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00010000:00010000:1.0:1788664352.189930:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664352.318437:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140540032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664352.318518:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664352.318699:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140540032 00000100:00100000:3.0:1788664352.318709:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140540032 00000100:00100000:3.0:1788664352.318791:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788664352.318801:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140540032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788664352.318833:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788664352.318882:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140540032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664352.318889:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788664352.318989:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140540032:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1788664352.839648:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788664352.839663:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1788664352.839668:0:7443:0:(genops.c:885:class_export_put()) final put ffff93c42f769000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788664352.839684:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc 00000001:00080000:0.0:1788664352.839689:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1788664352.839691:0:7443:0:(genops.c:885:class_export_put()) final put ffff93c4352e5800/6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc 00000001:00100000:0.0:1788664352.839695:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000001:00080000:0.0:1788664352.839699:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1788664352.839701:0:7443:0:(genops.c:885:class_export_put()) final put ffff93c43f7c9800/b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000020:00000080:2.0:1788664352.840306:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42f769000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788664352.840363:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c4352e5800/6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc for lustre-MDT0001 00000020:00000080:2.0:1788664352.840387:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43f7c9800/b07edea8-5696-4cd5-9a12-cefd3a8358e9 for lustre-MDT0001 00000020:00000080:2.0:1788664352.840413:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c42f76e800 for lustre-MDT0001 00000020:00000080:2.0:1788664352.840420:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c4352e2800 for lustre-MDT0001 00000020:00000080:2.0:1788664352.840425:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c302b95800 for lustre-MDT0001 00000001:00100000:2.0:1788664352.844621:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788664352.844632:0:9506:0:(genops.c:885:class_export_put()) final put ffff93c302983800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788664352.844662:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000020:00000080:2.0:1788664352.844664:0:9506:0:(genops.c:885:class_export_put()) final put ffff93c3041b1000/b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000001:00100000:3.0:1788664352.844741:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788664352.844746:0:6490:0:(genops.c:885:class_export_put()) final put ffff93c42f76f800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788664352.844756:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc 00000001:00080000:3.0:1788664352.844763:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967530 is committed 00000020:00000080:3.0:1788664352.844766:0:6490:0:(genops.c:885:class_export_put()) final put ffff93c4352e4000/6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc 00000001:00100000:3.0:1788664352.844803:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000001:00080000:3.0:1788664352.844828:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:3.0:1788664352.844836:0:6490:0:(genops.c:885:class_export_put()) final put ffff93c43f7ce000/b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000020:00000080:0.0:1788664352.844981:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c302983800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788664352.845031:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c3041b1000/b07edea8-5696-4cd5-9a12-cefd3a8358e9 for lustre-OST0001 00000020:00000080:0.0:1788664352.845050:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42f76f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788664352.845077:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c4352e4000/6f6f7b61-7b7c-4c8d-ae0b-c355c30d3cdc for lustre-MDT0000 00000020:00000080:0.0:1788664352.845105:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43f7ce000/b07edea8-5696-4cd5-9a12-cefd3a8358e9 for lustre-MDT0000 00000020:00000080:0.0:1788664352.845180:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c302983000 for lustre-OST0001 00000020:00000080:0.0:1788664352.845185:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c3041b3800 for lustre-OST0001 00000020:00000080:0.0:1788664352.845188:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c42f768800 for lustre-MDT0000 00000020:00000080:0.0:1788664352.845192:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c4352e2000 for lustre-MDT0000 00000020:00000080:0.0:1788664352.845195:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c43f7c9000 for lustre-MDT0000 00000001:00100000:0.0:1788664352.847268:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788664352.847276:0:8422:0:(genops.c:885:class_export_put()) final put ffff93c42e85f800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788664352.847332:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000020:00000080:0.0:1788664352.847335:0:8422:0:(genops.c:885:class_export_put()) final put ffff93c40392e800/b07edea8-5696-4cd5-9a12-cefd3a8358e9 00000020:00000080:3.0:1788664352.851523:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42e85f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788664352.851797:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c302982000 for lustre-OST0000 00000020:00000080:2.0:1788664352.852158:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c40392e800/b07edea8-5696-4cd5-9a12-cefd3a8358e9 for lustre-OST0000 00000020:00000080:2.0:1788664352.852264:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c40392f800 for lustre-OST0000 00010000:00010000:1.0:1788664353.214043:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664353.343540:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664353.343563:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140540160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664353.343632:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664353.344021:0:11573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140540160 00000100:00100000:2.0:1788664353.344029:0:11573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140540160 00000100:00100000:2.0:1788664353.344101:0:11573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788664353.344111:0:11573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140540160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788664353.344142:0:11573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788664353.344150:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664353.344220:0:11573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140540160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664353.344227:0:11573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788664353.344326:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140540160:0@lo:13:osp-pre-0-1.0 00000020:01000000:0.0:1788664353.534226:0:15151:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c3028bb4e0 - data ffff93c4385c71b0/ffff93c43f70f000 00000020:01000000:0.0:1788664353.534371:0:15151:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c403072120 - data ffff93c4385735e8/ffff93c42e88d400 00000001:00000004:0.0:1788664353.546422:0:15151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967530 00000100:00080000:0.0:1788664353.595968:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788664353.595976:0:15151:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788664353.595990:0:15151:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff93c303abdf80 x1875550140538112/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788664361 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664353.596012:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788664353.597764:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788664353.603686:0:15151:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1788664353.603713:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788664353.603716:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788664353.609303:0:8689:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788664353.609311:0:8689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1788664353.609328:0:8689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788664353.610671:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788664353.610689:0:15151:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1788664353.610708:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788664353.610711:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788664353.610970:0:9899:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788664353.610974:0:9899:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1788664353.610982:0:9899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788664353.628707:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d28d 00000020:00000080:3.0:1788664353.628719:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c43069b000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788664353.630140:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43069b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788664353.631969:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d2a2 00000020:00000080:3.0:1788664353.631981:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c43069a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788664353.632031:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788664353.632037:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788664353.632045:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788664353.632049:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff93c4227419c0) has no exports 00000004:01000000:3.0:1788664353.632208:0:15151:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788664353.632217:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d6d8 00000020:00000080:3.0:1788664353.632221:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c303731000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788664353.638192:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43069a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788664353.642035:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788664353.642051:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788664353.642067:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788664353.642072:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff93c302884d40) has no exports 00000020:00000080:3.0:1788664353.642081:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d6d1 00000020:00000080:3.0:1788664353.642090:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c303731800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788664353.642582:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c303731000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788664353.642596:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c303731800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788664353.644365:0:15151:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788664353.644372:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788664353.644376:0:15151:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788664353.644922:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788664353.644926:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788664353.644982:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788664353.644998:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788664353.645009:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d596 00000020:00000080:3.0:1788664353.645028:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c302970800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788664353.645035:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788664353.645040:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788664353.645046:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788664353.645049:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff93c3028db380) has no exports 00000020:00000080:3.0:1788664353.645055:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d58f 00000020:00000080:3.0:1788664353.645060:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c30291c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788664353.645449:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c303730000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788664353.645458:0:36:0:(genops.c:885:class_export_put()) final put ffff93c3029ff800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788664353.645461:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c3029ff800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788664353.645467:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788664353.645558:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c302970800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788664353.645562:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c30291c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788664353.649633:0:15151:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788664353.649641:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788664353.649646:0:15151:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788664353.649653:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788664353.649655:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788664353.649753:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788664353.649768:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788664353.649799:0:15151:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788664353.649807:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d446 00000020:00000080:3.0:1788664353.649815:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c42f78f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788664353.652635:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c30291e800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788664353.652653:0:36:0:(genops.c:885:class_export_put()) final put ffff93c43675c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788664353.652657:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43675c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788664353.652664:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788664353.656807:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788664353.657865:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788664353.657878:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788664353.657883:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff93c42e860000) has no exports 00000020:00000080:3.0:1788664353.657893:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d43f 00000020:00000080:3.0:1788664353.657901:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c430604800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788664353.660597:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42f78f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788664353.661853:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c430604800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788664353.669856:0:15151:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788664353.669864:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788664353.669869:0:15151:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788664353.669878:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788664353.670018:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664353.670048:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788664353.670103:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664353.670108:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788664353.670113:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c406b99000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788664353.670118:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff93c406b99000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788664353.670130:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788664353.670226:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d2a9 00000020:00000080:2.0:1788664353.670233:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c43069c800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788664353.670238:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788664353.670242:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664353.670256:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788664353.670260:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff93c4306acd40) has no exports 00000020:00000080:2.0:1788664353.670281:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664353.670284:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788664353.670289:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d2b0 00000020:00000080:2.0:1788664353.670293:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c430699000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788664353.670301:0:15151:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c40641a800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788664353.670304:0:15151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c40641a800 3 00000020:01000004:2.0:1788664353.670307:0:15151:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93c40641a800 from lustre-MDT0000 00000020:00000080:2.0:1788664353.670322:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664353.670326:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788664353.670328:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c43069e000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788664353.670330:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43069e000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788664353.670337:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788664353.670365:0:15151:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788664353.670369:0:15151:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788664353.670371:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788664353.670374:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664353.670376:0:15151:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788664353.670382:0:15151:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff93c403837800 a681e771-e9ab-478d-af58-39fce2e20de6 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788664353.670404:0:15151:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff93c412ca8000) has exports, disconnecting them 00000020:00080000:2.0:1788664353.670408:0:15151:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93c403837800), last request at 1788664074 00000020:00000080:2.0:1788664353.670428:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d24e 00000020:00010000:2.0:1788664353.670432:0:15151:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93c403837800: total 2 00000100:00080000:2.0:1788664353.670435:0:15151:0:(import.c:65:import_set_state_nolock()) ffff93c403835000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788664353.672141:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c403837800): rc 0 00000020:00080000:2.0:1788664353.672150:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff93c412ca8000) has no exports 00000100:00100000:2.0:1788664353.672224:0:6506:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff93c40853ce00:6506] 2 exiting: rc = 0 00000100:00100000:2.0:1788664353.672339:0:6504:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff93c42b8a3c00:6504] 0 exiting: rc = 1 00000100:00100000:2.0:1788664353.673360:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff93c410929a00:6505] 1 exiting: rc = 0 00000100:00100000:2.0:1788664353.673447:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.673455:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.673460:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.673465:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.673472:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.673936:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.673962:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.673969:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.673975:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.673981:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.673987:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.673992:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674003:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674010:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674019:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674025:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674031:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674037:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674043:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674049:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674055:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674061:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674066:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674071:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674076:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674098:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674104:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674112:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674117:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674123:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674128:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674133:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674139:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674144:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674150:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674155:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674161:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674167:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674173:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674178:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674184:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674190:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674196:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674201:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674206:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674213:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674219:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674224:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674229:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674235:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674240:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674257:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674264:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674270:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674275:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674280:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674286:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674291:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674297:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674301:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674427:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674434:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674440:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664353.674445:0:15151:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1788664353.674851:0:7453:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93c403837800: total 2 00010000:00010000:0.0:1788664353.674916:0:7453:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93c403837800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788664353.674950:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e2600/0xcd11f61c1413d795 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d78e expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664353.674971:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c400031a00/0xcd11f61c1413d34a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d343 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664353.674988:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40153a400/0xcd11f61c1413d358 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d351 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664353.675001:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303956a00/0xcd11f61c1413d9ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d9e8 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664353.675011:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e3600/0xcd11f61c1413d813 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d80c expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664353.675022:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c400031600/0xcd11f61c1413d7a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d79c expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664353.675033:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0d000/0xcd11f61c1413da0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413da04 expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664353.675042:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0c000/0xcd11f61c1413d66f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d668 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664353.675054:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c400030c00/0xcd11f61c1413d7bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d7b8 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664353.675077:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303b84400/0xcd11f61c1413d9fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d9f6 expref: 5 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664353.675089:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c402a0c800/0xcd11f61c1413d7cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d7c6 expref: 4 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664353.675099:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40153b400/0xcd11f61c1413d76b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d764 expref: 3 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664353.675109:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40153b600/0xcd11f61c1413d779 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd11f61c1413d772 expref: 2 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664353.675119:0:7453:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93c403837800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788664353.675136:0:7453:0:(genops.c:885:class_export_put()) final put ffff93c403837800/a681e771-e9ab-478d-af58-39fce2e20de6 00010000:00010000:0.0:1788664353.676015:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664353.676019:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664353.676022:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788664353.676040:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c430605800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788664353.676049:0:36:0:(genops.c:885:class_export_put()) final put ffff93c42f76c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788664353.676052:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42f76c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788664353.676068:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788664353.676768:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43069c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788664353.676799:0:36:0:(genops.c:885:class_export_put()) final put ffff93c43069c000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788664353.676801:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43069c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788664353.676805:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788664353.680159:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c430699000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788664353.680182:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c403837800/a681e771-e9ab-478d-af58-39fce2e20de6 for MGS 00000020:00000080:0.0:1788664353.680227:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c403835000 for MGS 00000020:01000000:2.0:1788664353.680548:0:15151:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c43535c000 - data ffff93c43870d1b0/ffff93c4047bb000 00000020:01000000:2.0:1788664353.680733:0:15151:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c404c83720 - data ffff93c438474d80/ffff93c42276b000 00000020:00000080:2.0:1788664353.681191:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d232 00000020:00000080:2.0:1788664353.681200:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c42da00800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788664353.681216:0:15151:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c40641a800 from MGS, refs=2 00000020:01000004:2.0:1788664353.681222:0:15151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c40641a800 2 00000020:01000004:2.0:1788664353.681224:0:15151:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93c40641a800 from MGS 00000020:00000080:2.0:1788664353.681242:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664353.681259:0:15151:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788664353.681262:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c403836000/MGS 00000020:00000080:2.0:1788664353.681265:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff93c403836000/MGS for MGS 00000020:01000000:2.0:1788664353.681270:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788664353.681329:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788664353.681332:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664353.681337:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788664353.681343:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff93c42778a800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788664353.681349:0:15151:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff93c4306ab380) has exports, disconnecting them 00000020:00080000:2.0:1788664353.681353:0:15151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff93c42778a800), last request at 1788664074 00000020:00000080:2.0:1788664353.681357:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d2fd 00000020:00080000:2.0:1788664353.681367:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c42778a800): rc 0 00000020:00000080:2.0:1788664353.681371:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c42778a800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788664353.682474:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42da00800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788664353.682485:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42778a800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788664353.698321:0:15151:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788664353.698330:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788664353.698334:0:15151:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788664353.698342:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788664353.698372:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c406b9b800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788664353.698544:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788664353.698552:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788664353.698557:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c42e8c5800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788664353.698560:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42e8c5800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788664353.698568:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788664353.698751:0:15151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c40641a800 1 00000020:00000080:0.0:1788664353.698758:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d224 00000020:00000080:0.0:1788664353.698766:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c403830000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788664353.698792:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788664353.698802:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c403830000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788664353.698829:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788664353.698834:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788664353.698838:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff93c4227dcd40) has no exports 00000020:00000080:0.0:1788664353.842070:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788664353.842083:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788664353.842088:0:15151:0:(genops.c:885:class_export_put()) final put ffff93c408bcf000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788664353.842092:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff93c408bcf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788664353.842097:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788664353.842351:0:15151:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93c408bcb800 00000020:02000400:0.0:1788664353.842533:0:15151:0:(tgt_mount.c:2186:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788664354.239400:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664355.261971:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664356.286759:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788664356.926060:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788664356.926070:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788664356.926075:0:36:0:(import.c:65:import_set_state_nolock()) ffff93c42f5f5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664356.926089:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 446 00000100:00100000:0.0:1788664356.926093:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140540288:0@lo:400:kworker.0 00000100:00080000:2.0:1788664356.926097:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788664356.926129:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93c42f5f5000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664356.926159:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039c8000 x1875550140540416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:0.0:1788664356.926175:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875550140540288 offset 0 length 224: 4 00000100:00080000:2.0:1788664356.926180:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788664356.926184:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788664356.926186:0:36:0:(import.c:65:import_set_state_nolock()) ffff93c42f788800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664356.926189:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 446 00000100:00080000:2.0:1788664356.926192:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788664356.926196:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93c42f788800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664356.926207:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039cb480 x1875550140540544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788664356.926215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788664356.926218:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788664356.926220:0:36:0:(import.c:65:import_set_state_nolock()) ffff93c30257d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664356.926223:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 446 00000100:00080000:2.0:1788664356.926319:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788664356.926325:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93c30257d800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664356.926339:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039c8700 x1875550140540672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788664356.926407:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1788664356.926410:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140540800:0@lo:400:kworker.0 00000100:00080000:2.0:1788664356.926411:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788664356.926413:0:36:0:(import.c:65:import_set_state_nolock()) ffff93c43675a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664356.926417:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 446 00000100:00080000:2.0:1788664356.926419:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788664356.926431:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93c43675a800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664356.926445:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039c9180 x1875550140541056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788664356.926456:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664356.926483:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788664356.926489:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140541312:0@lo:400:kworker.0 00000100:00100000:2.0:1788664356.926494:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140540928:0@lo:400:kworker.0 00000100:00100000:0.0:1788664356.926519:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664356.926535:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664356.926556:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664356.926557:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140540800 00000100:00100000:2.0:1788664356.926561:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140541184:0@lo:400:kworker.0 00000100:00100000:0.0:1788664356.926565:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140540800 00000100:00100000:2.0:1788664356.926581:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664356.926612:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140541312 00000100:00100000:2.0:1788664356.926615:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140541312 00000100:00100000:0.0:1788664356.926633:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140541184 00000100:00100000:0.0:1788664356.926636:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140541184 00000100:00100000:2.0:1788664356.926642:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140540928 00000100:00100000:2.0:1788664356.926644:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140540928 00000100:00100000:2.0:1788664356.926662:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788664356.926662:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1788664356.926670:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140540800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664356.926683:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140541312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664356.926734:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140540800:12345-0@lo:400:kworker.0 Request processed in 64us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664356.926742:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1788664356.926810:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1788664356.926818:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140541184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664356.926851:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140541184:12345-0@lo:400:kworker.0 Request processed in 35us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664356.926857:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1788664356.926942:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140540416:0@lo:38:kworker.0 00000100:00100000:3.0:1788664356.926981:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664356.926981:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140541312:12345-0@lo:400:kworker.0 Request processed in 312us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664356.926988:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788664356.927004:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875550140540544:0@lo:38:kworker.0 00000100:00100000:3.0:1788664356.927026:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664356.927026:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788664356.927034:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140540928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664356.927042:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1875550140540672:0@lo:38:kworker.0 00000100:00100000:3.0:1788664356.927060:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664356.927065:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140540928:12345-0@lo:400:kworker.0 Request processed in 33us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664356.927071:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788664356.927074:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1875550140541056:0@lo:38:kworker.0 00010000:00080000:2.0:1788664356.927104:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff93c3039c9c00 x1875550140541184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664356.927106:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664356.927119:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140541184:0@lo:400:kworker.0 00000100:00100000:2.0:1788664356.927132:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140540928:0@lo:400:kworker.0 00000100:00100000:3.0:1788664356.927143:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140540416 00000100:00100000:3.0:1788664356.927147:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140540416 00000100:00100000:3.0:1788664356.927171:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788664356.927176:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1875550140540416:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788664356.927200:0:6517:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788664356.927262:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1875550140540416:12345-0@lo:38:kworker.0 Request processed in 85us (280us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788664356.927268:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788664356.927288:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140540544 00000100:00100000:3.0:1788664356.927292:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140540544 00000100:00100000:3.0:1788664356.927309:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140540672 00000100:00100000:3.0:1788664356.927311:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140540672 00000100:00100000:3.0:1788664356.927319:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140541056 00000100:00100000:3.0:1788664356.927321:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140541056 00000100:00100000:3.0:1788664356.927330:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788664356.927336:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3635:x1875550140540544:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788664356.927346:0:9524:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788664356.927371:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3635:x1875550140540544:12345-0@lo:38:kworker.0 Request processed in 35us (345us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788664356.927376:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788664356.927387:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788664356.927391:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3635:x1875550140540672:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788664356.927400:0:9524:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788664356.927424:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3635:x1875550140540672:12345-0@lo:38:kworker.0 Request processed in 31us (362us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788664356.927430:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788664356.927449:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788664356.927454:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3635:x1875550140541056:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788664356.927464:0:9524:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788664356.927497:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3635:x1875550140541056:12345-0@lo:38:kworker.0 Request processed in 41us (390us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788664356.927502:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1788664356.927944:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c42f5f5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664356.927952:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788664356.927956:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140540416:0@lo:38:kworker.0 00000100:00080000:2.0:1788664356.927965:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c42f788800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664356.927969:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788664356.927972:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875550140540544:0@lo:38:kworker.0 00000100:00080000:2.0:1788664356.927982:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c30257d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664356.927984:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788664356.927987:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1875550140540672:0@lo:38:kworker.0 00000100:00080000:2.0:1788664356.927996:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c43675a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664356.927999:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788664356.928002:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1875550140541056:0@lo:38:kworker.0 00000100:00100000:0.0:1788664356.928110:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140541312:0@lo:400:kworker.0 00010000:00080000:0.0:1788664356.928124:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff93c3039c9500 x1875550140540800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664356.928134:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140540800:0@lo:400:kworker.0 00000100:00080000:0.0:1788664356.928184:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788664356.928190:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664356.928193:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788664357.310285:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664357.438460:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664357.438493:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140541440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664357.438600:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664357.438795:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140541440 00000100:00100000:1.0:1788664357.438807:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140541440 00000100:00100000:1.0:1788664357.438863:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788664357.438874:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140541440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788664357.438916:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788664357.438982:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140541440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664357.438989:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788664357.439167:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140541440:0@lo:13:osp-pre-1-1.0 00000020:01000004:1.0:1788664358.245369:0:15352:0:(tgt_mount.c:2197:server_umount_begin()) umount -f 00000020:01000004:0.0:1788664358.269259:0:15352:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788664358.269317:0:15352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.269333:0:15352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d7bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.269341:0:15352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d7bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.269348:0:15352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d7bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.270691:0:15352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788664358.270701:0:15352:0:(mgc_request.c:545:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788664358.270735:0:15352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788664358.270739:0:15352:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788664358.270745:0:15352:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788664358.270751:0:15352:0:(import.c:65:import_set_state_nolock()) ffff93c42f788800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788664358.270756:0:15352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788664358.270757:0:15352:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788664358.270760:0:15352:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788664358.271717:0:15352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.271740:0:15352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d7cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.271748:0:15352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d7cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.271796:0:15352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d7cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664358.275980:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788664358.275994:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d7bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664358.276005:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351efa00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1788664358.276010:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d7bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664358.276021:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d7bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664358.276049:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d7bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664358.276056:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788664358.276059:0:6499:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788664358.276062:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788664358.276105:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d7bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664358.276112:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664358.276141:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d7bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664358.276149:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4351efa00/0xcd11f61c1413d7b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d7bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664358.276163:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664358.276167:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d7cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664358.276173:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4351eee00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1788664358.276176:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d7cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664358.276184:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d7cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664358.276191:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d7cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664358.276206:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788664358.276209:0:6499:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1788664358.277180:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d7cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664358.277192:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664358.277205:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d7cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664358.277215:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664358.277227:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664358.277229:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664358.277258:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140541568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788664358.277328:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664358.277388:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664358.277394:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140541696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788664358.277418:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664358.280610:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140541568 00000100:00100000:2.0:1788664358.280626:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140541568 00000100:00100000:2.0:1788664358.280684:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140541696 00000100:00100000:2.0:1788664358.280688:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140541696 00000100:00100000:2.0:1788664358.280712:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788664358.280721:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3636:x1875550140541568:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788664358.280728:0:8443:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788664358 with bad export cookie 14776862452835668558 00000100:00100000:1.0:1788664358.282083:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788664358.282093:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4047b2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3636:x1875550140541696:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788664358.282101:0:6498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788664358 with bad export cookie 14776862452835668558 00000100:00100000:1.0:1788664358.282200:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4047b2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3636:x1875550140541696:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (4780us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788664358.282208:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788664358.282269:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788664358.282274:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93c42b0d4800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788664358.282278:0:3636:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1788664358.285547:0:15352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788664358.285562:0:15352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4351eee00/0xcd11f61c1413d7c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d7cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.285592:0:15352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d66f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.285599:0:15352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d66f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.285606:0:15352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d66f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.285612:0:15352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d66f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.285634:0:15352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788664358.285640:0:15352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413da0b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.285645:0:15352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413da0b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.285651:0:15352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413da0b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.285672:0:15352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413da0b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.285682:0:15352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788664358.285687:0:15352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413d351 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d358 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.285693:0:15352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413d351 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d358 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.285699:0:15352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413d351 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d358 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.285704:0:15352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413d351 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d358 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.285711:0:15352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1788664358.285714:0:15352:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1788664358.285720:0:15352:0:(mgc_request.c:545:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788664358.285754:0:15352:0:(tgt_mount.c:2117:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788664358.285759:0:15352:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788664358.285763:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788664358.285768:0:15352:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788664358.285792:0:15352:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff93c302b93000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788664358.285798:0:15352:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff93c302568800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788664358.285803:0:15352:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff93c4227d99c0) has exports, disconnecting them 00000020:00080000:0.0:1788664358.285807:0:15352:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff93c302b93000), last request at 1788664356 00000020:00000080:0.0:1788664358.285814:0:15352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d630 00000100:00080000:0.0:1788664358.285836:0:15352:0:(import.c:65:import_set_state_nolock()) ffff93c302b97000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788664358.285877:0:15352:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c302b93000): rc 0 00000020:00000080:0.0:1788664358.285879:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c302b93000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788664358.285895:0:15352:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff93c302568800), last request at 1788664356 00000020:00000080:0.0:1788664358.285898:0:15352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d50a 00000100:00080000:0.0:1788664358.285903:0:15352:0:(import.c:65:import_set_state_nolock()) ffff93c30256d000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788664358.285909:0:15352:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c302568800): rc 0 00000020:00000080:0.0:1788664358.285911:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c302568800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788664358.285917:0:15352:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffaa6d40ddbae8 00000100:00080000:0.0:1788664358.285936:0:15352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788664358.285940:0:15352:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1788664358.286700:0:15352:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788664358.286706:0:15352:0:(import.c:65:import_set_state_nolock()) ffff93c42f5f5000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788664358.286873:0:15352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788664358.286875:0:15352:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1788664358.286887:0:15352:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788664358.286942:0:15352:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788664358.286963:0:15352:0:(import.c:65:import_set_state_nolock()) ffff93c43675a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788664358.286979:0:15352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788664358.286981:0:15352:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1788664358.286987:0:15352:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788664358.287043:0:15352:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788664358.287051:0:15352:0:(import.c:65:import_set_state_nolock()) ffff93c43f7cf800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788664358.287072:0:15352:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff93c4227d99c0) has no exports 00010000:00010000:0.0:1788664358.287105:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788664358.287112:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d66f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.287121:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40153ac00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664358.287135:0:6499:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d66f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.287145:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d66f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664358.287152:0:6499:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d66f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664358.287159:0:6499:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788664358.287161:0:6499:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788664358.287163:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788664358.287246:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788664358.287253:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413da0b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664358.287260:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85e00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1788664358.287263:0:7453:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413da0b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664358.287270:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413da0b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664358.287276:0:7453:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413da0b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664358.287281:0:7453:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788664358.287284:0:7453:0:(mgc_request.c:942:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788664358.287286:0:7453:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00000080:2.0:1788664358.293279:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c302b93000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788664358.293363:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c302568800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788664358.293404:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c302b97000 for lustre-MDT0001 00000020:00000080:2.0:1788664358.293429:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c30256d000 for lustre-MDT0001 00000100:00100000:2.0:1788664358.293478:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f8a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140541824:0@lo:9:umount.0 00000100:00100000:2.0:1788664358.293571:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664358.293614:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c43f8ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140541952:0@lo:9:umount.0 00000100:00100000:2.0:1788664358.293633:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664358.294085:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140541824 00000100:00100000:2.0:1788664358.294096:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140541824 00000100:00100000:2.0:1788664358.294158:0:9895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140541952 00000100:00100000:2.0:1788664358.294160:0:9895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140541952 00000100:00100000:2.0:1788664358.294181:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788664358.294190:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875550140541824:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788664358.294236:0:9895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d557 00000100:00080000:2.0:1788664358.294246:0:9895:0:(import.c:65:import_set_state_nolock()) ffff93c42e858800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788664358.294295:0:9895:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788664358.294465:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3635:x1875550140541824:12345-0@lo:9:umount.0 Request processed in 275us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664358.294474:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788664358.294489:0:9895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788664358.294495:0:9895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875550140541952:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788664358.294507:0:9895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d699 00000100:00080000:2.0:1788664358.294513:0:9895:0:(import.c:65:import_set_state_nolock()) ffff93c4352e6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788664358.294530:0:9895:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788664358.294607:0:9895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3635:x1875550140541952:12345-0@lo:9:umount.0 Request processed in 112us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664358.294613:0:9895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788664358.294634:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664358.294637:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664358.295297:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c43675a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788664358.295340:0:3635:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788664358.295343:0:3635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788664358.295348:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f8a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140541824:0@lo:9:umount.0 00000100:00080000:2.0:1788664358.295370:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c43f7cf800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788664358.295374:0:3635:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788664358.295376:0:3635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788664358.295378:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c43f8ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140541952:0@lo:9:umount.0 00000100:00100000:2.0:1788664358.295478:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3636:x1875550140541568:12345-0@lo:103:ldlm_bl.0 Request processed in 14757us (18148us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788664358.296580:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1788664358.312834:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664358.313005:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664358.313016:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413d351 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d358 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.313028:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664358.313033:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413d351 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d358 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.313044:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413d351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d358 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664358.313051:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413d351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d358 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664358.313057:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788664358.313060:0:6500:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788664358.313063:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:1.0:1788664358.329196:0:3636:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.152@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788664358.329239:0:3636:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788664358.329252:0:3636:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c3039c8e00 x1875550140540288/t0(0) o400->MGC192.168.203.152@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788664372 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664358.329286:0:3636:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c422669f80 x1875550140541568/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788664374 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664358.329297:0:3636:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c422668380 x1875550140541696/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788664374 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788664358.329316:0:3636:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788664358.329319:0:3636:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788664358.329320:0:3636:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1788664358.332184:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d66f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.332202:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664358.332250:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d66f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.332258:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c40153ac00/0xcd11f61c1413d668 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d66f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664358.332285:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788664358.332391:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a681e771-e9ab-478d-af58-39fce2e20de6:0:1875550140542080:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664358.332415:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664358.332418:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664358.332421:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664358.332426:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664358.332429:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664358.333153:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:3638:1875550140540288:0@lo:400:kworker.0 00010000:00010000:2.0:1788664358.344092:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413d351 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d358 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.344125:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664358.344168:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413d351 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d358 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.344176:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413d351 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413d358 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664358.344202:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664358.344240:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a681e771-e9ab-478d-af58-39fce2e20de6:0:1875550140542208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664358.344263:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664358.344266:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664358.344269:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664358.344280:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413da0b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.344287:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664358.344302:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413da0b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.344309:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413da04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd11f61c1413da0b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.344318:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664358.344320:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664358.344321:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664358.344374:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664358.344391:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a681e771-e9ab-478d-af58-39fce2e20de6:0:1875550140542336:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788664358.352307:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93c42b0d4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788664358.352327:0:3636:0:(import.c:545:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 169 00000100:00080000:1.0:1788664358.352341:0:3636:0:(import.c:665:import_select_connection()) MGC192.168.203.152@tcp: import ffff93c42b0d4800 using connection 192.168.203.152@tcp/0@lo 00010000:00010000:2.0:1788664358.352494:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664358.352648:0:3636:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3035a5880 x1875550140542464/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664358.353158:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a681e771-e9ab-478d-af58-39fce2e20de6:3635:1875550140542464:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1788664358.353231:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875550140542464 offset 0 length 520: 4 00000100:00100000:1.0:1788664358.353252:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140541568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788664358.353305:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a681e771-e9ab-478d-af58-39fce2e20de6:3636:1875550140541696:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788664358.366179:0:15352:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff93c4227d99c0) has no exports 00000020:01000000:1.0:1788664358.449568:0:15352:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c3028bb7e0 - data ffff93c3021f9000/ffff93c43f70d000 00000020:01000000:1.0:1788664358.450224:0:15352:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c435091960 - data ffff93c43842e6c0/ffff93c43508d000 00000001:00000004:1.0:1788664358.462346:0:15352:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1788664358.521383:0:15352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788664358.521392:0:15352:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788664358.521401:0:15352:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788664358.531091:0:15352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788664358.531098:0:15352:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1788664358.531122:0:15352:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788664358.531125:0:15352:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788664358.531485:0:8674:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788664358.531490:0:8674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788664358.531499:0:8674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788664358.532190:0:15352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788664358.532195:0:15352:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788664358.532226:0:15352:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788664358.532228:0:15352:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788664358.532578:0:9893:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788664358.532588:0:9893:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1788664358.532597:0:9893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788664358.533669:0:15352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d374 00000020:00000080:2.0:1788664358.533679:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c43455a000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788664358.534727:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43455a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788664358.536051:0:15352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d389 00000020:00000080:2.0:1788664358.536063:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c434558800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788664358.536080:0:15352:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788664358.536086:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664358.536094:0:15352:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788664358.536098:0:15352:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff93c4227db380) has no exports 00000020:00000080:0.0:1788664358.536311:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c434558800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:2.0:1788664358.536397:0:15352:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788664358.536407:0:15352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d692 00000020:00000080:2.0:1788664358.536412:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c43f7cf000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788664358.536456:0:15352:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788664358.536461:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664358.536468:0:15352:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788664358.536479:0:15352:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff93c3028d99c0) has no exports 00000020:00000080:2.0:1788664358.536486:0:15352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d68b 00000020:00000080:2.0:1788664358.536490:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c43f7c8000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788664358.537126:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43f7cf000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:2.0:1788664358.537911:0:15352:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788664358.537916:0:15352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788664358.537920:0:15352:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1788664358.537926:0:15352:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788664358.537928:0:15352:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788664358.538039:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43f7c8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788664358.538111:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664358.538120:0:15352:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788664358.538138:0:15352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d550 00000020:00000080:2.0:1788664358.538144:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c30257a800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788664358.538148:0:15352:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788664358.538152:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664358.538156:0:15352:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788664358.538159:0:15352:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff93c3028dcd40) has no exports 00000020:00000080:2.0:1788664358.538163:0:15352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d549 00000020:00000080:2.0:1788664358.538166:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c42e8c7000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788664358.538297:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c43f7cf800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788664358.538304:0:38:0:(genops.c:885:class_export_put()) final put ffff93c302b95000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788664358.538307:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c302b95000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788664358.538313:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788664358.538388:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c30257a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788664358.538393:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42e8c7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788664358.540447:0:15352:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788664358.540454:0:15352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788664358.540458:0:15352:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:0.0:1788664358.540475:0:15352:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788664358.540478:0:15352:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788664358.540526:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788664358.540536:0:15352:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788664358.540549:0:15352:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788664358.540566:0:15352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d3ac 00000020:00000080:0.0:1788664358.540574:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c42f76a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788664358.540667:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c43675a000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788664358.540675:0:38:0:(genops.c:885:class_export_put()) final put ffff93c30257e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788664358.540677:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c30257e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788664358.540683:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788664358.540758:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42f76a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1788664358.541044:0:15352:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788664358.541062:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788664358.541068:0:15352:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788664358.541072:0:15352:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff93c4306a99c0) has no exports 00000020:00000080:0.0:1788664358.541079:0:15352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d3a5 00000020:00000080:0.0:1788664358.541083:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c42f5f0800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788664358.542314:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42f5f0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788664358.543933:0:15352:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1788664358.543939:0:15352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788664358.543943:0:15352:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788664358.543961:0:15352:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788664358.544014:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788664358.544025:0:15352:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788664358.544067:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788664358.544081:0:15352:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788664358.544086:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c42e858000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788664358.544089:0:15352:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42e858000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788664358.544096:0:15352:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788664358.544283:0:15352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d390 00000020:00000080:1.0:1788664358.544289:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c43455f800/lustre-MDD0001_UUID 00000020:01000000:1.0:1788664358.544294:0:15352:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1788664358.544298:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788664358.544302:0:15352:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788664358.544305:0:15352:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff93c4227d8000) has no exports 00000020:00000080:1.0:1788664358.544324:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788664358.544327:0:15352:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1788664358.544330:0:15352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d397 00000020:00000080:1.0:1788664358.544334:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c434558000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1788664358.544341:0:15352:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c42d99f800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1788664358.544344:0:15352:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c42d99f800 2 00000020:01000004:1.0:1788664358.544347:0:15352:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93c42d99f800 from lustre-MDT0001 00000020:00000080:1.0:1788664358.544361:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788664358.544364:0:15352:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788664358.544366:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c43455c800/lustre-MDT0001_UUID 00000020:00000080:1.0:1788664358.544368:0:15352:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43455c800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788664358.544375:0:15352:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1788664358.544404:0:15352:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788664358.544407:0:15352:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788664358.544410:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788664358.544413:0:15352:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788664358.544419:0:15352:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff93c42f78d000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788664358.544424:0:15352:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff93c4306a8000) has exports, disconnecting them 00000020:00080000:1.0:1788664358.544429:0:15352:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff93c42f78d000), last request at 1788664096 00000020:00000080:1.0:1788664358.544432:0:15352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d3eb 00000020:00080000:1.0:1788664358.544442:0:15352:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c42f78d000): rc 0 00000020:00000080:1.0:1788664358.544452:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c42f78d000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788664358.544678:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c42f5f5000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788664358.544685:0:38:0:(genops.c:885:class_export_put()) final put ffff93c43069f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788664358.544687:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43069f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1788664358.544691:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788664358.544814:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43455f800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788664358.544817:0:38:0:(genops.c:885:class_export_put()) final put ffff93c43455f000/lustre-MDD0001_UUID 00000020:00000080:2.0:1788664358.544819:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43455f000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1788664358.544823:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1788664358.544984:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c434558000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788664358.544989:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42f78d000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1788664358.556925:0:15352:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1788664358.556936:0:15352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788664358.556941:0:15352:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788664358.556955:0:15352:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788664358.556997:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c42f788800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788664358.557173:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664358.557181:0:15352:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788664358.557186:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c42b0d3000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788664358.557191:0:15352:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42b0d3000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788664358.557196:0:15352:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1788664358.557280:0:15352:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c42d99f800 1 00000020:00000080:2.0:1788664358.557286:0:15352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d327 00000020:00000080:2.0:1788664358.557292:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c42778c000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1788664358.557300:0:15352:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1788664358.557308:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42778c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788664358.557317:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664358.557321:0:15352:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788664358.557326:0:15352:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff93c42e8619c0) has no exports 00000020:00000080:2.0:1788664358.666707:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664358.666718:0:15352:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1788664358.666724:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c42d999000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788664358.666729:0:15352:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42d999000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788664358.666740:0:15352:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1788664358.666875:0:15352:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93c42d99b800 00000020:01000000:2.0:1788664358.666903:0:15352:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788664358.666907:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664358.666911:0:15352:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788664358.666915:0:15352:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff93c422743380) has no exports 00000100:00100000:3.0:1788664358.667468:0:9524:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff93c3036fcc00:9524] 4 exiting: rc = 0 00000100:00100000:3.0:1788664358.667588:0:6511:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff93c42b36a400:6511] 0 exiting: rc = 1 00000100:00100000:3.0:1788664358.667646:0:6512:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff93c422790600:6512] 1 exiting: rc = 0 00000100:00100000:0.0:1788664358.668111:0:9169:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff93c30295ec00:9169] 3 exiting: rc = 0 00000100:00100000:1.0:1788664358.668387:0:6513:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff93c422791200:6513] 2 exiting: rc = 0 00000100:00100000:3.0:1788664358.672899:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.672912:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.672936:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.672944:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.672951:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.672957:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.672963:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.672970:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.672976:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.672982:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.672989:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.672995:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673001:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673006:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673012:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673017:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673023:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673029:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673034:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673053:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673060:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673067:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673073:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673079:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673084:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673090:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673096:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673103:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673109:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673114:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673121:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673126:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673132:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673138:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673144:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673151:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673156:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673169:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673174:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673180:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673186:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673191:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673196:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673201:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673206:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673211:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673228:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673234:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673239:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673244:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673248:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673253:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673258:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673263:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673268:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673273:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673280:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673285:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673290:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673296:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673303:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673309:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673315:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.673339:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.681531:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93c422791400:6515] 1 exiting: rc = 0 00000100:00100000:3.0:1788664358.681744:0:6514:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93c422790a00:6514] 0 exiting: rc = 1 00000100:00100000:1.0:1788664358.682392:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682401:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682406:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682412:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682418:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682424:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682431:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682437:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682444:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682450:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682455:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682460:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682466:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682472:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682476:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682481:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682485:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682490:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682495:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682500:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682505:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682509:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682514:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682519:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682524:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682528:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682532:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682537:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682542:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682559:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682565:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682571:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682575:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682592:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682598:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682603:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682609:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682614:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682620:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682625:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682630:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682636:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682642:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682647:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682651:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682657:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682664:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682669:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682675:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682680:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682685:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682690:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682695:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682702:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682708:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682713:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682719:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682725:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682730:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682736:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682741:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682747:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.682753:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.683448:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.684300:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff93c422790c00:6517] 1 exiting: rc = 0 00000100:00100000:0.0:1788664358.684697:0:7860:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff93c435162c00:7860] 2 exiting: rc = 0 00000100:00100000:1.0:1788664358.685477:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff93c422790200:6516] 0 exiting: rc = 1 00000100:00100000:2.0:1788664358.686015:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.686034:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.686043:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.686050:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.686055:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.686071:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.686077:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.686083:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688205:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688227:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688253:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688260:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688266:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688273:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688279:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688285:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688290:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688295:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688300:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688306:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688311:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688316:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688335:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688343:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688349:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688356:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688362:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688368:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688374:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688380:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688386:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688392:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688398:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688404:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688424:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688432:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688437:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688443:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688450:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688456:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688477:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688482:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688488:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688494:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688500:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688505:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688523:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688529:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688534:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688540:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688560:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688568:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688574:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688580:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688587:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688593:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688600:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688606:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688627:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688637:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688642:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688648:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688656:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.688663:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664358.707553:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93c422790000:6518] 0 exiting: rc = 1 00000100:00100000:3.0:1788664358.707632:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93c42b315c00:6519] 1 exiting: rc = 0 00000100:00100000:3.0:1788664358.707695:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707704:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707709:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707715:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707721:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707726:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707745:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707751:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707756:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707762:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707767:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707895:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707901:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707906:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707910:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707915:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707921:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707926:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707931:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707936:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707942:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707947:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707952:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707957:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707962:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707967:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707972:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707976:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707981:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707986:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707991:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.707996:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708001:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708006:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708011:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708016:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708021:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708026:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708031:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708036:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708041:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708053:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708062:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708067:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708072:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708077:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708083:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708088:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708093:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708098:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708103:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708109:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708114:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708118:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708123:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708128:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708133:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708138:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708143:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708148:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708153:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708158:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708163:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708168:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.708649:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93c42b901c00:6521] 1 exiting: rc = 0 00000100:00100000:0.0:1788664358.708924:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93c406899400:6520] 0 exiting: rc = 1 00000100:00100000:2.0:1788664358.709049:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709056:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709062:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709068:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709073:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709079:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709085:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709090:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709095:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709102:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709107:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709124:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709130:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709135:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709141:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709145:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709151:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709156:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709162:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709167:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709171:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709176:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709182:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709186:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709191:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709197:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709202:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709207:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709212:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709229:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709234:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709239:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709244:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709249:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709254:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709259:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709263:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709270:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709276:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709282:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709287:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709292:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709298:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709303:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709309:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709314:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709328:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709333:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709338:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709343:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709348:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709354:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709359:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709364:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709369:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709374:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709380:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709385:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709390:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709394:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709399:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709403:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709408:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.709413:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664358.710010:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff93c42b901400:6523] 1 exiting: rc = 0 00000100:00100000:0.0:1788664358.710135:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff93c42b900c00:6522] 0 exiting: rc = 1 00000100:00100000:2.0:1788664358.710239:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710245:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710254:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710260:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710265:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710270:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710275:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710281:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710287:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710292:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710299:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710304:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710309:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710315:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710320:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710325:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710329:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710345:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710350:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710356:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710361:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710365:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710370:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710376:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710381:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710385:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710391:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710395:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710400:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710405:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710409:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710414:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710418:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710423:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710428:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710432:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710436:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710441:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710445:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710450:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710455:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710460:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710465:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710470:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710475:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710479:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710484:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710488:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710492:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710496:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710501:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710506:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710518:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710523:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710529:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710534:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710539:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710738:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710747:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710752:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710757:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710761:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710767:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.710878:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664358.711458:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff93c405030e00:6524] 0 exiting: rc = 1 00000100:00100000:1.0:1788664358.711724:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff93c42dad4400:6525] 1 exiting: rc = 0 00000100:00100000:1.0:1788664358.711897:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff93c4116ab000:6526] 2 exiting: rc = 0 00000100:00100000:2.0:1788664358.712078:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712085:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712090:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712096:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712102:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712107:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712113:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712118:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712123:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712129:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712135:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712142:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712147:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712153:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712159:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712172:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712178:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712184:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712189:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712195:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712200:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712205:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712211:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712231:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712237:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712243:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712248:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712253:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712258:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712263:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712269:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712273:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712278:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712283:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712289:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712295:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712301:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712305:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712311:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712332:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712338:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712343:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712348:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712353:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712358:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712364:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712370:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712375:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712381:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712386:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712392:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712397:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712401:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712407:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712413:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712419:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712426:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712431:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712442:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712448:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712454:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712459:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712465:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664358.712471:0:15352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788664358.717415:0:15352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664358.717427:0:15352:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788664358.717432:0:15352:0:(genops.c:885:class_export_put()) final put ffff93c42b0d2000/MDS_uuid 00000020:00000080:2.0:1788664358.717437:0:15352:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42b0d2000/MDS_uuid for MDS 00000020:01000000:2.0:1788664358.717447:0:15352:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788664358.717763:0:15352:0:(tgt_mount.c:2186:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788664359.368054:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664360.381965:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664361.406378:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788664362.046633:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a681e771-e9ab-478d-af58-39fce2e20de6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788664362.046640:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a681e771-e9ab-478d-af58-39fce2e20de6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788664362.046642:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788664362.046646:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788664362.046651:0:8:0:(import.c:65:import_set_state_nolock()) ffff93c30257d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788664362.046660:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 452 00000100:00080000:3.0:1788664362.046666:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788664362.046695:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93c30257d800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788664362.046732:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c4350fea00 x1875550140542592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664362.046832:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1875550140542592:0@lo:38:kworker.0 00000400:00000100:2.0:1788664362.046888:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550140542592 offset 0 length 520: 4 00000100:00100000:1.0:1788664362.048167:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140542720:0@lo:400:kworker.0 00000400:00000100:1.0:1788664362.048232:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550140542720 offset 0 length 224: 4 00000100:00080000:3.0:1788664362.049555:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788664362.049563:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788664362.049566:0:8:0:(import.c:65:import_set_state_nolock()) ffff93c43675a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788664362.049572:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 452 00000100:00080000:3.0:1788664362.049578:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788664362.049585:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93c43675a800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788664362.049616:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c4350fca80 x1875550140542848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664362.051610:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1875550140542848:0@lo:38:kworker.0 00000400:00000100:2.0:1788664362.051669:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550140542848 offset 0 length 520: 4 00000100:00100000:3.0:1788664362.052941:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664362.052958:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140542976:0@lo:400:kworker.0 00000400:00000100:3.0:1788664362.053228:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550140542976 offset 0 length 224: 4 00010000:00010000:2.0:1788664362.435510:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788664363.078150:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a681e771-e9ab-478d-af58-39fce2e20de6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788664363.078158:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a681e771-e9ab-478d-af58-39fce2e20de6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664363.078161:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788664363.078165:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664363.078244:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788664363.078248:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788664363.078278:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664363.078297:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140543104:0@lo:400:kworker.0 00000400:00000100:1.0:1788664363.078348:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550140543104 offset 0 length 224: 4 00000100:00100000:1.0:1788664363.078505:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140543232:0@lo:400:kworker.0 00000400:00000100:1.0:1788664363.078529:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550140543232 offset 0 length 224: 4 00000020:01000004:2.0:1788664363.419200:0:15554:0:(tgt_mount.c:2197:server_umount_begin()) umount -f 00000020:01000004:2.0:1788664363.437066:0:15554:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788664363.437116:0:15554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664363.437132:0:15554:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664363.437139:0:15554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664363.437146:0:15554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664363.437195:0:15554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788664363.437201:0:15554:0:(mgc_request.c:545:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788664363.437234:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788664363.437246:0:15554:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c4350fea00 x1875550140542592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788664382 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664363.437268:0:15554:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788664363.437273:0:15554:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788664363.437279:0:15554:0:(import.c:65:import_set_state_nolock()) ffff93c30257d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788664363.437283:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788664363.437287:0:15554:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c4350fea00 x1875550140542592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788664382 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664363.437293:0:15554:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788664363.437296:0:15554:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:3.0:1788664363.437365:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1875550140542592:0@lo:38:kworker.0 00010000:00010000:0.0:1788664363.438566:0:15353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664363.438576:0:15353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664363.438587:0:15353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40153a600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664363.438591:0:15353:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664363.438601:0:15353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664363.438609:0:15353:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664363.438615:0:15353:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788664363.438618:0:15353:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788664363.438620:0:15353:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788664363.438645:0:15353:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c42b0d4800 00010000:00010000:0.0:1788664363.438649:0:15353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd11f61c1413d795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664363.438656:0:15353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c40153a600/0xcd11f61c1413d78e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd11f61c1413d795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664363.438668:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664363.438670:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664363.438672:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788664363.439375:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788664363.439387:0:15554:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c4350ff800 x1875550140542720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664378 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664363.439408:0:15554:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c30480ea00 x1875550140543104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664379 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664363.439429:0:15554:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788664363.439435:0:15554:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788664363.439470:0:15554:0:(import.c:65:import_set_state_nolock()) ffff93c302578000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788664363.439607:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140543104:0@lo:400:kworker.0 00000100:00100000:3.0:1788664363.439637:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1875550140543360:0@lo:39:umount.0 00000400:00000100:3.0:1788664363.439677:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550140543360 offset 0 length 224: 4 00000100:00100000:0.0:1788664363.439801:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140542720:0@lo:400:kworker.0 00010000:00010000:2.0:1788664363.454040:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788664363.583734:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788664363.583743:0:8422:0:(genops.c:885:class_export_put()) final put ffff93c42e859800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788664363.583974:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42e859800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788664363.584206:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c42e858800 for lustre-OST0000 00000001:00100000:2.0:1788664363.584756:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788664363.584760:0:9506:0:(genops.c:885:class_export_put()) final put ffff93c4352e1000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788664363.584914:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c4352e1000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788664363.585285:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c4352e6000 for lustre-OST0001 00010000:00010000:2.0:1788664364.478106:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664365.502558:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664366.526053:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788664367.102949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a681e771-e9ab-478d-af58-39fce2e20de6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788664367.102969:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a681e771-e9ab-478d-af58-39fce2e20de6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664367.102973:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788664367.102977:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788664367.103108:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140543488:0@lo:400:kworker.0 00000400:00000100:0.0:1788664367.103172:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550140543488 offset 0 length 224: 4 00010000:00010000:2.0:1788664367.550080:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664368.576596:0:3635:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664358/real 1788664358] req@ffff93c3035a5880 x1875550140542464/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788664368 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664368.576627:0:3635:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c3035a5880 x1875550140542464/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788664368 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788664368.576645:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c42b0d4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788664368.576690:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788664368.576695:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a681e771-e9ab-478d-af58-39fce2e20de6:3635:1875550140542464:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1788664368.576798:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a681e771-e9ab-478d-af58-39fce2e20de6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788664368.576803:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788664368.576806:0:8:0:(import.c:65:import_set_state_nolock()) ffff93c42b0d4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788664368.576811:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 453 00000100:00080000:0.0:1788664368.576817:0:8:0:(import.c:630:import_select_connection()) MGC192.168.203.152@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788664368.576824:0:8:0:(import.c:665:import_select_connection()) MGC192.168.203.152@tcp: import ffff93c42b0d4800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788664368.576852:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3035a5500 x1875550140543616/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788664368.576877:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788664368.576880:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788664368.576974:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140543744:0@lo:400:kworker.0 00000400:00000100:1.0:1788664368.577026:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550140543744 offset 0 length 224: 4 00000100:00100000:3.0:1788664368.578375:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a681e771-e9ab-478d-af58-39fce2e20de6:3635:1875550140543616:0@lo:250:kworker.0 00000400:00000100:3.0:1788664368.578431:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875550140543616 offset 0 length 520: 4 00010000:00010000:2.0:1788664368.579344:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664369.605112:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664370.622461:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664371.647909:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664372.671812:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664373.693991:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664373.694078:0:3635:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664363/real 1788664363] req@ffff93c3039c8000 x1875550140543360/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788664373 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664373.694108:0:3635:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c3039c8000 x1875550140543360/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788664373 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788664373.694204:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c302578000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788664373.694262:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1875550140543360:0@lo:39:umount.0 00000100:00080000:2.0:1788664373.701255:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788664373.701263:0:15554:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788664373.701270:0:15554:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788664373.702174:0:15554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d7a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664373.702190:0:15554:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d7a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664373.702198:0:15554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d7a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664373.702206:0:15554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d7a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664373.702226:0:15554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788664373.702233:0:15554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d9fd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664373.702240:0:15554:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d9fd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664373.702246:0:15554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d9fd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664373.702270:0:15554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d9fd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664373.702292:0:15554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788664373.702297:0:15554:0:(mgc_request.c:545:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788664373.702324:0:15554:0:(tgt_mount.c:2117:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788664373.702329:0:15554:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788664373.702333:0:15554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664373.702339:0:15554:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788664373.702344:0:15554:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff93c42e864d40) has no exports 00000020:00080000:2.0:1788664373.702365:0:15554:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff93c42e864d40) has no exports 00000020:01000000:2.0:1788664373.704064:0:15554:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c43535cc60 - data ffff93c43870d798/ffff93c4047bbc00 00010000:00010000:3.0:1788664373.704388:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788664373.704397:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d7a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664373.704408:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400031400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1788664373.704412:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d7a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664373.704423:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d7a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664373.704430:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d7a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664373.704437:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788664373.704439:0:6500:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788664373.704457:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788664373.704475:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c42b0d4800 00010000:00010000:3.0:1788664373.704478:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd11f61c1413d7a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664373.704486:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c400031400/0xcd11f61c1413d79c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd11f61c1413d7a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664373.704499:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664373.704503:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d9fd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664373.704508:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1788664373.704511:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d9fd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664373.704518:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d9fd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664373.704523:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d9fd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664373.704528:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788664373.704530:0:6500:0:(mgc_request.c:942:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788664373.704532:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788664373.704536:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c42b0d4800 00010000:00010000:3.0:1788664373.704539:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd11f61c1413d9fd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664373.704545:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413d9f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd11f61c1413d9fd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664373.704564:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664373.704566:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664373.704567:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664373.704745:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788664373.711107:0:15554:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c4046972a0 - data ffff93c4386bdca8/ffff93c43673a400 00100000:10000000:3.0:1788664373.730628:0:15554:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788664373.750460:0:15554:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d4c4 00000020:00000080:0.0:1788664373.750473:0:15554:0:(genops.c:885:class_export_put()) final put ffff93c4351ba000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788664373.750496:0:15554:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c42f78b000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788664373.750500:0:15554:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c42f78b000 2 00000020:01000004:0.0:1788664373.750503:0:15554:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93c42f78b000 from lustre-OST0000 00000020:00000080:0.0:1788664373.750540:0:15554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788664373.750550:0:15554:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788664373.750553:0:15554:0:(genops.c:885:class_export_put()) final put ffff93c435282000/lustre-OST0000_UUID 00000020:00000080:0.0:1788664373.750556:0:15554:0:(genops.c:844:class_export_destroy()) destroying export ffff93c435282000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788664373.750563:0:15554:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788664373.750623:0:15554:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788664373.750627:0:15554:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788664373.750631:0:15554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788664373.750635:0:15554:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788664373.750642:0:15554:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff93c30257e000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788664373.750648:0:15554:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff93c4353719c0) has exports, disconnecting them 00000020:00080000:0.0:1788664373.750653:0:15554:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff93c30257e000), last request at 1788664117 00000020:00000080:0.0:1788664373.750656:0:15554:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d4ee 00000020:00080000:0.0:1788664373.750665:0:15554:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c30257e000): rc 0 00000020:00000080:0.0:1788664373.750671:0:15554:0:(genops.c:885:class_export_put()) final put ffff93c30257e000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788664373.750927:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c4351ba000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788664373.750938:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c30257e000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788664373.755986:0:15554:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788664373.755995:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788664373.756000:0:15554:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788664373.756007:0:15554:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788664373.756192:0:15554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788664373.756201:0:15554:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788664373.756208:0:15554:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788664373.756215:0:15554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788664373.756219:0:15554:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788664373.756226:0:15554:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff93c30257f800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788664373.756233:0:15554:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff93c435370000) has exports, disconnecting them 00000020:00080000:1.0:1788664373.756237:0:15554:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff93c30257f800), last request at 1788664117 00000020:00000080:1.0:1788664373.756241:0:15554:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d503 00000020:00080000:1.0:1788664373.756258:0:15554:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c30257f800): rc 0 00000020:00000080:1.0:1788664373.756264:0:15554:0:(genops.c:885:class_export_put()) final put ffff93c30257f800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788664373.756932:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c30257d800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788664373.756940:0:8:0:(genops.c:885:class_export_put()) final put ffff93c43675d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788664373.756943:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c43675d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788664373.756950:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788664373.757014:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c30257f800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788664373.766109:0:15554:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788664373.766146:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788664373.766150:0:15554:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788664373.766159:0:15554:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788664373.766189:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c302578000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788664373.766404:0:15554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788664373.766414:0:15554:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788664373.766419:0:15554:0:(genops.c:885:class_export_put()) final put ffff93c30257b000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788664373.766423:0:15554:0:(genops.c:844:class_export_destroy()) destroying export ffff93c30257b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788664373.766429:0:15554:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788664373.766500:0:15554:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c42f78b000 1 00000020:00000080:3.0:1788664373.766505:0:15554:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d48c 00000020:00000080:3.0:1788664373.766513:0:15554:0:(genops.c:885:class_export_put()) final put ffff93c42f679800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788664373.766521:0:15554:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788664373.766529:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42f679800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788664373.766538:0:15554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788664373.766552:0:15554:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788664373.766557:0:15554:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff93c435374d40) has no exports 00000100:00080000:3.0:1788664373.821934:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a681e771-e9ab-478d-af58-39fce2e20de6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788664373.821945:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a681e771-e9ab-478d-af58-39fce2e20de6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788664373.821949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788664373.821952:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788664373.822198:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664373.822220:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140543872:0@lo:400:kworker.0 00000400:00000100:1.0:1788664373.822275:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550140543872 offset 0 length 224: 4 00000020:00000080:3.0:1788664374.000374:0:15554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788664374.000468:0:15554:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788664374.000475:0:15554:0:(genops.c:885:class_export_put()) final put ffff93c42f788000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788664374.000480:0:15554:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42f788000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788664374.000493:0:15554:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788664374.000689:0:15554:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93c42f789800 00000020:02000400:3.0:1788664374.000824:0:15554:0:(tgt_mount.c:2186:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788664374.720760:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664375.749552:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664376.766795:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664377.790962:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788664377.882971:0:15756:0:(tgt_mount.c:2197:server_umount_begin()) umount -f 00000020:01000004:2.0:1788664377.902453:0:15756:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788664377.902533:0:15756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d76b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664377.902549:0:15756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d76b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664377.902557:0:15756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d76b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664377.902564:0:15756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d76b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664377.902953:0:15756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788664377.902959:0:15756:0:(mgc_request.c:545:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788664377.903017:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788664377.903028:0:15756:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c4350fca80 x1875550140542848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788664382 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664377.903042:0:15756:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788664377.903071:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c43675a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664377.903099:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1788664377.903103:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1875550140542848:0@lo:38:kworker.0 00000100:00080000:2.0:1788664377.903127:0:15756:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788664377.903132:0:15756:0:(import.c:65:import_set_state_nolock()) ffff93c43675a800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788664377.903136:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788664377.903138:0:15756:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788664377.903141:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788664377.903971:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788664377.903981:0:15756:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c4350fce00 x1875550140542976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664378 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664377.903998:0:15756:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c30480c380 x1875550140543232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664379 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664377.904010:0:15756:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c30480ea00 x1875550140543488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664383 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664377.904022:0:15756:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c3035a7480 x1875550140543744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664384 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664377.904033:0:15756:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c4350fea00 x1875550140543872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664389 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664377.904040:0:15756:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1788664377.904064:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140542976:0@lo:400:kworker.0 00000100:00080000:2.0:1788664377.904096:0:15756:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788664377.904124:0:15756:0:(import.c:65:import_set_state_nolock()) ffff93c430698800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788664377.904147:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1875550140544000:0@lo:39:umount.0 00000400:00000100:2.0:1788664377.904189:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550140544000 offset 0 length 224: 4 00000100:00080000:0.0:1788664377.904417:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a681e771-e9ab-478d-af58-39fce2e20de6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788664377.904423:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a681e771-e9ab-478d-af58-39fce2e20de6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788664377.904459:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140543488:0@lo:400:kworker.0 00000100:00100000:0.0:1788664377.904505:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140543232:0@lo:400:kworker.0 00000100:00100000:0.0:1788664377.904530:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140543872:0@lo:400:kworker.0 00000100:00100000:0.0:1788664377.904546:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140543744:0@lo:400:kworker.0 00010000:00010000:3.0:1788664377.904548:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664377.904556:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d76b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664377.904565:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1788664377.904569:0:7453:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d76b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664377.904580:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d76b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664377.904587:0:7453:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d76b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664377.904592:0:7453:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788664377.904601:0:7453:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788664377.904604:0:7453:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788664377.904617:0:7453:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c42b0d4800 00010000:00010000:3.0:1788664377.904621:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd11f61c1413d76b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664377.904627:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4029e2000/0xcd11f61c1413d764 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd11f61c1413d76b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664377.904639:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664377.904641:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664377.904643:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664378.814691:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664379.837975:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664380.865118:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664381.886157:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664382.910138:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664383.037966:0:3635:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664368/real 1788664368] req@ffff93c3035a5500 x1875550140543616/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788664383 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664383.038011:0:3635:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c3035a5500 x1875550140543616/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788664383 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788664383.038029:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a681e771-e9ab-478d-af58-39fce2e20de6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788664383.038037:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a681e771-e9ab-478d-af58-39fce2e20de6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788664383.038046:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c42b0d4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664383.038080:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788664383.038085:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a681e771-e9ab-478d-af58-39fce2e20de6:3635:1875550140543616:0@lo:250:kworker.0 00000100:00080000:3.0:1788664383.038095:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a681e771-e9ab-478d-af58-39fce2e20de6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788664383.038101:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788664383.038104:0:38:0:(import.c:65:import_set_state_nolock()) ffff93c42b0d4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788664383.038111:0:38:0:(import.c:545:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 463 00000100:00080000:3.0:1788664383.038118:0:38:0:(import.c:630:import_select_connection()) MGC192.168.203.152@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788664383.038136:0:38:0:(import.c:665:import_select_connection()) MGC192.168.203.152@tcp: import ffff93c42b0d4800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788664383.038179:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c4350fe300 x1875550140544128/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664383.038241:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a681e771-e9ab-478d-af58-39fce2e20de6:3635:1875550140544128:0@lo:250:kworker.0 00000400:00000100:2.0:1788664383.038305:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875550140544128 offset 0 length 520: 4 00010000:00010000:3.0:1788664383.934220:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664384.961369:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664385.982171:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664387.006581:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664387.133882:0:3635:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664377/real 1788664377] req@ffff93c3039c9880 x1875550140544000/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788664387 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664387.133926:0:3635:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c3039c9880 x1875550140544000/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788664387 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788664387.133952:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c430698800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788664387.133980:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1875550140544000:0@lo:39:umount.0 00000100:00080000:3.0:1788664387.135695:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788664387.135705:0:15756:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788664387.135737:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788664387.137216:0:15756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d779 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664387.137236:0:15756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d779 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664387.137244:0:15756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d779 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664387.137252:0:15756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d779 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664387.137299:0:15756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664387.137309:0:15756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413d9ef expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664387.137616:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664387.137625:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d779 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664387.137650:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40153be00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664387.137655:0:6500:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d779 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664387.137665:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d779 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664387.137673:0:6500:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d779 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664387.137679:0:6500:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788664387.137682:0:6500:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1788664387.137697:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c42b0d4800 00010000:00010000:2.0:1788664387.137701:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd11f61c1413d779 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664387.137708:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c40153be00/0xcd11f61c1413d772 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd11f61c1413d779 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664387.137728:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664387.137730:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664387.137732:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664387.137936:0:15756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413d9ef expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664387.137945:0:15756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d9ef expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664387.137952:0:15756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd11f61c1413d9ef expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664387.138013:0:15756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788664387.138019:0:15756:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788664387.138032:0:15756:0:(mgc_request.c:545:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788664387.138070:0:15756:0:(tgt_mount.c:2117:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788664387.138076:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788664387.138089:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788664387.138096:0:15756:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788664387.138101:0:15756:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff93c302880000) has no exports 00000020:00080000:3.0:1788664387.138128:0:15756:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff93c302880000) has no exports 00000020:01000000:3.0:1788664387.141690:0:15756:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c43535c060 - data ffff93c4386be6c0/ffff93c4047b9400 00000020:01000000:3.0:1788664387.142112:0:15756:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c3037a0d20 - data ffff93c438564360/ffff93c43f74dc00 00010000:00010000:0.0:1788664387.142528:0:15353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664387.142540:0:15353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d9ef expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664387.142556:0:15353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85a00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664387.142561:0:15353:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd11f61c1413d9ef expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664387.142573:0:15353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d9ef expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664387.142581:0:15353:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d9ef expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664387.142587:0:15353:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788664387.142590:0:15353:0:(mgc_request.c:942:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788664387.142594:0:15353:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788664387.142614:0:15353:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c42b0d4800 00010000:00010000:0.0:1788664387.142618:0:15353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd11f61c1413d9ef expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664387.142625:0:15353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c303b85a00/0xcd11f61c1413d9e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd11f61c1413d9ef expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664387.142643:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664387.142645:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664387.142647:0:15353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788664387.153821:0:15756:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788664387.165259:0:15756:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d5ea 00000020:00000080:2.0:1788664387.165286:0:15756:0:(genops.c:885:class_export_put()) final put ffff93c3029fe000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788664387.165310:0:15756:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c302578800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788664387.165314:0:15756:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c302578800 2 00000020:01000004:2.0:1788664387.165316:0:15756:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93c302578800 from lustre-OST0001 00000020:00000080:2.0:1788664387.165343:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664387.165353:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788664387.165370:0:15756:0:(genops.c:885:class_export_put()) final put ffff93c3029fd800/lustre-OST0001_UUID 00000020:00000080:2.0:1788664387.165373:0:15756:0:(genops.c:844:class_export_destroy()) destroying export ffff93c3029fd800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788664387.165380:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788664387.165551:0:15756:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a681e771-e9ab-478d-af58-39fce2e20de6->MGS 00010000:00010000:2.0:1788664387.165567:0:15756:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4029e2400/0xcd11f61c1413d343 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d34a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664387.165579:0:15756:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2400/0xcd11f61c1413d343 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d34a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664387.165586:0:15756:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788664387.165589:0:15756:0:(mgc_request.c:952:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788664387.165592:0:15756:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788664387.165606:0:15756:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c42b0d4800 00010000:00010000:2.0:1788664387.165610:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4029e2400/0xcd11f61c1413d343 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd11f61c1413d34a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664387.165625:0:15756:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d80c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd11f61c1413d813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664387.165632:0:15756:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d80c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd11f61c1413d813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664387.165638:0:15756:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788664387.165640:0:15756:0:(mgc_request.c:952:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788664387.165642:0:15756:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788664387.165650:0:15756:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c42b0d4800 00010000:00010000:2.0:1788664387.165653:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4351ee800/0xcd11f61c1413d80c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd11f61c1413d813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788664387.165668:0:15756:0:(import.c:65:import_set_state_nolock()) ffff93c42b0d4800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788664387.165678:0:15756:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788664387.165680:0:15756:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788664387.165682:0:15756:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788664387.165686:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788664387.165698:0:15756:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c4350fe300 x1875550140544128/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788664403 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788664387.165714:0:15756:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788664387.165717:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:2.0:1788664387.165746:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a681e771-e9ab-478d-af58-39fce2e20de6:3635:1875550140544128:0@lo:250:kworker.0 10000000:01000000:2.0:1788664387.165789:0:15756:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788664387.165795:0:15756:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d240 00000020:00000080:2.0:1788664387.165799:0:15756:0:(genops.c:885:class_export_put()) final put ffff93c42b0d1000/a681e771-e9ab-478d-af58-39fce2e20de6 00000020:01000000:2.0:1788664387.165806:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.152@tcp (flags='') 00000020:00000080:2.0:1788664387.165811:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664387.165816:0:15756:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.152@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788664387.165819:0:15756:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff93c422744d40) has no exports 00000020:00000080:0.0:1788664387.166223:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c3029fe000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788664387.166254:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42b0d1000/a681e771-e9ab-478d-af58-39fce2e20de6 for MGC192.168.203.152@tcp 10000000:01000000:0.0:1788664387.166328:0:6508:0:(mgc_request.c:706:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788664387.166816:0:15756:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.152@tcp: client import never connected 00000100:00080000:2.0:1788664387.166823:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788664387.166825:0:15756:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788664387.166829:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788664387.166832:0:15756:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788664387.166897:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788664387.166906:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c42b0d4800 for MGC192.168.203.152@tcp 00000020:00000080:2.0:1788664387.166907:0:15756:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.152@tcp (uuid a681e771-e9ab-478d-af58-39fce2e20de6) 00000020:00000080:0.0:1788664387.166925:0:38:0:(genops.c:885:class_export_put()) final put ffff93c42b0d3800/a681e771-e9ab-478d-af58-39fce2e20de6 00000020:01000000:2.0:1788664387.166928:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788664387.166932:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42b0d3800/a681e771-e9ab-478d-af58-39fce2e20de6 for MGC192.168.203.152@tcp 00000020:00000080:2.0:1788664387.166937:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:01000000:0.0:1788664387.166941:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.152@tcp (a681e771-e9ab-478d-af58-39fce2e20de6) 00000020:00000080:2.0:1788664387.166954:0:15756:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788664387.166961:0:15756:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93c30256c800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788664387.166967:0:15756:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff93c412cacd40) has exports, disconnecting them 00000020:00080000:2.0:1788664387.166971:0:15756:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93c30256c800), last request at 1788664139 00000020:00000080:2.0:1788664387.166975:0:15756:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d614 00000020:00080000:2.0:1788664387.169037:0:15756:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c30256c800): rc 0 00000020:00000080:2.0:1788664387.169064:0:15756:0:(genops.c:885:class_export_put()) final put ffff93c30256c800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788664387.169177:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c30256c800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788664387.171984:0:15756:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788664387.171993:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788664387.171997:0:15756:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788664387.172005:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788664387.172079:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c43675a800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788664387.172229:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788664387.172239:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788664387.172245:0:15756:0:(genops.c:885:class_export_put()) final put ffff93c302975800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788664387.172250:0:15756:0:(genops.c:844:class_export_destroy()) destroying export ffff93c302975800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788664387.172257:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788664387.172654:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788664387.172658:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788664387.172663:0:15756:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788664387.172670:0:15756:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff93c434559000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788664387.172676:0:15756:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff93c412cab380) has exports, disconnecting them 00000020:00080000:0.0:1788664387.172681:0:15756:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff93c434559000), last request at 1788664139 00000020:00000080:0.0:1788664387.172684:0:15756:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d629 00000020:00080000:0.0:1788664387.172700:0:15756:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c434559000): rc 0 00000020:00000080:0.0:1788664387.172705:0:15756:0:(genops.c:885:class_export_put()) final put ffff93c434559000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788664387.172753:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c434559000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788664387.175907:0:15756:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788664387.175919:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788664387.175926:0:15756:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788664387.175936:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788664387.175996:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c430698800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788664387.176107:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788664387.182015:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788664387.183494:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1788664387.183757:0:15353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1788664387.184080:0:13730:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff93c30398ca00:13730] 2 exiting: rc = 0 00000100:00100000:1.0:1788664387.184190:0:6494:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93c404c43a00:6494] 0 exiting: rc = 1 00000100:00100000:1.0:1788664387.210085:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93c404c42e00:6495] 1 exiting: rc = 0 00000100:00100000:1.0:1788664387.210210:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.210609:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93c42b972e00:6498] 2 exiting: rc = 0 00000100:00100000:2.0:1788664387.211578:0:8443:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93c301e0a400:8443] 3 exiting: rc = 0 00000100:00100000:3.0:1788664387.211651:0:10332:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff93c3035d5a00:10332] 4 exiting: rc = 0 00000100:00100000:3.0:1788664387.211847:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93c42b973c00:6497] 1 exiting: rc = 0 00000100:00100000:3.0:1788664387.211940:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff93c42b973e00:6496] 0 exiting: rc = 1 00000100:00100000:1.0:1788664387.212660:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.212670:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.212677:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.212682:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.212687:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.212695:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.212701:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.212707:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.212712:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.212718:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.212723:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.212739:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.212746:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.212753:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.212760:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.212765:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213066:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213073:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213078:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213085:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213091:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213096:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213101:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213106:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213126:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213131:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213135:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213140:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213145:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213150:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213155:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213160:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213165:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213170:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213175:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213181:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213186:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213191:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213196:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213201:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213206:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213211:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213215:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213220:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213224:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213229:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213234:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213238:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213242:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213247:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213252:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213257:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213261:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213266:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.213271:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.214400:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.214416:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.214421:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.214426:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.214442:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.214448:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.214453:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.214458:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664387.214471:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788664387.217688:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788664387.217701:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788664387.217707:0:15756:0:(genops.c:885:class_export_put()) final put ffff93c30256a000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788664387.217712:0:15756:0:(genops.c:844:class_export_destroy()) destroying export ffff93c30256a000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788664387.217717:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788664387.217789:0:15756:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c302578800 1 00000020:00000080:1.0:1788664387.217795:0:15756:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd11f61c1413d5b9 00000020:00000080:1.0:1788664387.217802:0:15756:0:(genops.c:885:class_export_put()) final put ffff93c302987800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788664387.217813:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788664387.217824:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93c302987800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788664387.217836:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788664387.217841:0:15756:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788664387.217844:0:15756:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff93c3028819c0) has no exports 00000020:00000080:1.0:1788664387.279747:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788664387.279766:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788664387.279795:0:15756:0:(genops.c:885:class_export_put()) final put ffff93c435284000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788664387.279802:0:15756:0:(genops.c:844:class_export_destroy()) destroying export ffff93c435284000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788664387.279814:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788664387.280202:0:15756:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93c42e8c2800 00000020:01000000:1.0:1788664387.280241:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788664387.280246:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788664387.280251:0:15756:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788664387.280256:0:15756:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff93c435373380) has no exports 00000020:00000080:1.0:1788664387.280678:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788664387.280689:0:15756:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788664387.280693:0:15756:0:(genops.c:885:class_export_put()) final put ffff93c42f67e000/OSS_uuid 00000020:00000080:1.0:1788664387.280695:0:15756:0:(genops.c:844:class_export_destroy()) destroying export ffff93c42f67e000/OSS_uuid for OSS 00000020:01000000:1.0:1788664387.280712:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1788664387.280830:0:6507:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788664387.280941:0:9895:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff93c43510ae00:9895] 3 exiting: rc = 0 00000100:00100000:3.0:1788664387.281345:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff93c42263de00:8428] 1 exiting: rc = 0 00000100:00100000:1.0:1788664387.281848:0:15065:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff93c4116ab400:15065] 4 exiting: rc = 0 00000100:00100000:0.0:1788664387.282345:0:8426:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff93c42263ca00:8426] 0 exiting: rc = 1 00000100:00100000:2.0:1788664387.285922:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff93c4344dd200:8429] 2 exiting: rc = 0 00000100:00100000:0.0:1788664387.289795:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289823:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289830:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289837:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289844:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289850:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289857:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289863:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289871:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289877:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289883:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289889:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289895:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289900:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289906:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289912:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289919:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289925:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289930:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289936:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289942:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289948:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289955:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289962:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289969:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289976:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289983:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289991:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.289998:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290006:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290013:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290020:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290039:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290046:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290052:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290060:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290076:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290082:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290088:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290094:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290101:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290114:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290135:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290142:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290149:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290155:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290161:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290168:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290174:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290181:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290201:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290206:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290212:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290218:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290223:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290229:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290236:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290243:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290248:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290255:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290266:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290357:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290366:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.290377:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.293955:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93c4344dc600:8430] 0 exiting: rc = 1 00000100:00100000:0.0:1788664387.294214:0:11573:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff93c43cf8fc00:11573] 2 exiting: rc = 0 00000100:00100000:2.0:1788664387.296280:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93c43510f000:8431] 1 exiting: rc = 0 00000100:00100000:0.0:1788664387.297675:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297707:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297716:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297722:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297730:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297755:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297761:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297767:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297789:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297794:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297800:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297805:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297811:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297817:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297822:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297828:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297834:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297839:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297845:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297851:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297856:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297861:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297867:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297873:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297879:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297885:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297890:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297896:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297902:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297908:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297914:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297919:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297926:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297931:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297937:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297942:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297948:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297953:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297962:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297972:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297985:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297991:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.297997:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298003:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298008:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298014:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298020:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298037:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298044:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298050:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298056:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298061:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298066:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298071:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298077:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298091:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298099:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298104:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298110:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298116:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298122:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298128:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298133:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.298146:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.299599:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93c43510e800:8432] 0 exiting: rc = 1 00000100:00100000:2.0:1788664387.299840:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93c4344f6000:8433] 1 exiting: rc = 0 00000100:00100000:2.0:1788664387.300839:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93c4344f7200:8434] 2 exiting: rc = 0 00000100:00100000:0.0:1788664387.301048:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301057:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301063:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301069:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301076:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301092:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301099:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301106:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301112:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301118:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301141:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301148:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301155:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301163:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301169:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301175:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301181:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301187:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301193:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301199:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301206:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301224:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301241:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301258:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301290:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301298:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301304:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301310:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301318:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301324:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301331:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301337:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301343:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301354:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301361:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301371:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301379:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301385:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301391:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301397:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301403:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301410:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301418:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301426:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301434:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301446:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301452:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301459:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301465:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301472:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301488:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301495:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301502:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301508:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301514:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301531:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301538:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301544:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301551:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301557:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301571:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301696:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301704:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.301718:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.308535:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93c402e38a00:8436] 1 exiting: rc = 0 00000100:00100000:2.0:1788664387.308631:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93c402e39800:8435] 0 exiting: rc = 1 00000100:00100000:0.0:1788664387.309413:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309422:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309428:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309434:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309439:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309445:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309450:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309455:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309462:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309468:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309474:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309480:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309485:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309490:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309495:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309515:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309529:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309535:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309541:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309546:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309551:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309556:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309561:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309566:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.309572:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310134:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310144:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310150:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310155:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310161:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310166:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310172:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310178:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310183:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310188:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310193:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310198:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310203:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310208:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310212:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310218:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310224:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310229:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310234:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310239:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310244:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310249:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310255:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310259:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310264:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310340:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310346:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310351:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310357:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310362:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310368:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310374:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310379:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310385:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310389:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310394:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310399:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310404:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.310409:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788664387.311673:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93c4350dfa00:8437] 0 exiting: rc = 1 00000100:00100000:3.0:1788664387.311821:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93c4350e7400:8438] 1 exiting: rc = 0 00000100:00100000:0.0:1788664387.312084:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312106:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312145:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312154:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312163:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312170:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312177:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312184:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312192:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312200:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312208:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312215:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312223:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312232:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312256:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312267:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312349:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312359:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312367:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312377:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312385:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312405:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312414:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312421:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312431:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312438:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312464:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312473:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312480:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312487:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312495:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312501:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312508:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312515:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312524:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312531:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312538:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312545:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312568:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312639:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312648:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312654:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312661:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312667:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312673:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312680:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312686:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312693:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312700:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312708:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312729:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312737:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312744:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312750:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312757:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312763:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312876:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312884:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312891:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312900:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312908:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312921:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312927:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664387.312942:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788664387.339172:0:15756:0:(tgt_mount.c:2186:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788664407.026124:0:16521:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788664418.837110:0:17122:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:2.0:1788664418.837116:0:17122:0:(obd_mount.c:924:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788664418.837117:0:17122:0:(obd_mount.c:927:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788664418.838029:0:17122:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c43f740000 00000020:01000004:2.0:1788664418.838057:0:17122:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788664418.838067:0:17122:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788664418.838082:0:17122:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93c302880000) 00000020:00000080:2.0:1788664418.838096:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788664418.910805:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788664418.913176:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.918566:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788664418.921473:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.921875:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.922143:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.922324:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.922514:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.923040:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.923284:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.923568:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.923910:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.924149:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.924329:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.924668:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.925096:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.925397:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.925634:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.926079:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.926312:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.928183:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.928425:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.928865:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.929056:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.929302:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.929496:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.929933:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.930133:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.930318:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.930507:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.930977:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.931225:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.931944:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788664418.932157:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.932343:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788664418.932981:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1788664418.933235:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1788664418.933453:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1788664418.933895:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1788664418.934178:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788664418.934507:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788664418.934901:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788664418.935761:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788664418.936890:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1788664418.937928:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788664418.938350:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788664418.938579:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788664418.939458:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788664418.940083:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1788664418.940304:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788664418.941133:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788664418.942508:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1788664418.944262:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:1.0:1788664418.947503:0:17122:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788664418.956021:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788664418.956037:0:17122:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788664418.956057:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413e7fd 00000020:01000004:1.0:1788664418.956067:0:17122:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788664418.956072:0:17122:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788664418.956080:0:17122:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c43f740000 from MGS 00000020:01000004:1.0:1788664418.956084:0:17122:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788664418.956097:0:17122:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93c4227d99c0) 00000020:00000080:1.0:1788664418.956110:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788664418.956194:0:17122:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c43f740000 from MGS, refs=2 00080000:01000000:1.0:1788664418.956208:0:17122:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788664418.956214:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413e80b 00000100:00100000:1.0:1788664418.956359:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788664418.956564:0:17122:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788664418.956569:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788664418.958806:0:17122:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788664418.958827:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788664418.960057:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664418.960235:0:17122:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788664418.960240:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788664418.960992:0:17122:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788664418.961000:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788664418.966338:0:17122:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788664418.966352:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788664418.967590:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664418.967594:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664418.967596:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664418.969626:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664418.969631:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664418.969633:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664418.970295:0:17122:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788664418.972157:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788664418.978348:0:17122:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788664418.979423:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788664418.979464:0:17122:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788664418.979504:0:17122:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788664418.988344:0:17122:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788664418.988725:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664418.988920:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788664418.988926:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788664418.992947:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788664418.993026:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788664418.993994:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788664418.994004:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1788664418.995616:0:17139:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788664418.995756:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788664418.995809:0:17122:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.152@tcp' 00000020:01000004:0.0:1788664418.995820:0:17122:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788664418.995853:0:17122:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.152@tcp (typ=mgc) 00000020:00000080:0.0:1788664418.995865:0:17122:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.152@tcp (ffff93c412cacd40) 00000020:00000080:0.0:1788664418.995882:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788664418.995968:0:17122:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c3042e0800@MGC192.168.203.152@tcp: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1788664418.996147:0:17122:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.152@tcp-0 is initialized 00000040:01000000:0.0:1788664418.996153:0:17122:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788664419.006142:0:17140:0:(mgc_request.c:629:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788664419.006267:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.152@tcp (uuid 3b799a9c-462a-4acf-8dbe-41fb3ef57cfd) 00000020:00000080:0.0:1788664419.006288:0:17122:0:(genops.c:1385:class_connect()) connect: client 3b799a9c-462a-4acf-8dbe-41fb3ef57cfd, cookie 0xcd11f61c1413e819 00000100:00080000:0.0:1788664419.006301:0:17122:0:(import.c:545:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788664419.006308:0:17122:0:(import.c:665:import_select_connection()) MGC192.168.203.152@tcp: import ffff93c3042e0800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788664419.006341:0:17122:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3035a4a80 x1875550140544256/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664419.006440:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3635:1875550140544256:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788664419.006503:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664419.006590:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140544256 00000100:00100000:3.0:1788664419.006598:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140544256 00000100:00100000:3.0:1788664419.006628:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788664419.006636:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3635:x1875550140544256:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788664419.006659:0:17136:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3b799a9c-462a-4acf-8dbe-41fb3ef57cfd@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:3.0:1788664419.006682:0:17136:0:(genops.c:1385:class_connect()) connect: client 3b799a9c-462a-4acf-8dbe-41fb3ef57cfd, cookie 0xcd11f61c1413e820 00000100:00080000:3.0:1788664419.006844:0:17136:0:(import.c:65:import_set_state_nolock()) ffff93c303737800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788664419.007032:0:17122:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3b799a9c-462a-4acf-8dbe-41fb3ef57cfd->MGS 00000020:01000004:0.0:1788664419.007049:0:17122:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788664419.007054:0:17122:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788664419.007136:0:17122:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93c412ca99c0) 00000020:00000080:0.0:1788664419.007151:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788664419.011172:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+5:3635:x1875550140544256:12345-0@lo:250:mount.lustre.0 Request processed in 4524us (4657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664419.011189:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788664419.013185:0:3635:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788664419.013219:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.152@tcp: connect to target with instance 0 00000100:00080000:2.0:1788664419.013296:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788664419.013303:0:3635:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788664419.013308:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c3042e0800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788664419.013311:0:3635:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788664419.013329:0:3635:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788664419.013336:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3635:1875550140544256:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788664419.024255:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788664419.026568:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788664419.026580:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788664419.027695:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788664419.027707:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788664419.028254:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788664419.028262:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788664419.029507:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788664419.029675:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788664419.029681:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788664419.030396:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788664419.030404:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788664419.077619:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788664419.084831:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788664419.084839:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788664419.086610:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788664419.086763:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788664419.088103:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788664419.088293:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788664419.088299:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788664419.090260:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788664419.090272:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788664419.091029:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788664419.091189:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788664419.091195:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788664419.092444:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788664419.092454:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788664419.093243:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788664419.093406:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788664419.093412:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788664419.094459:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788664419.094468:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788664419.117066:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664419.117293:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788664419.117300:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788664419.120053:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788664419.120066:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788664419.121218:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788664419.121229:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788664419.123269:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788664419.123302:0:17122:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788664419.123579:0:17122:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788664419.124016:0:17122:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788664419.124183:0:17122:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788664419.124187:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788664419.124189:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788664419.124190:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664419.124191:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664419.124192:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664419.124194:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664419.124195:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788664419.124196:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788664419.124198:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664419.124199:0:17122:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788664419.124201:0:17122:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788664419.124204:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788664419.124205:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788664419.124206:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664419.124207:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664419.124213:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664419.124215:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664419.124216:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788664419.124216:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788664419.124217:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664419.124218:0:17122:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788664419.124242:0:17122:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788664419.124263:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140544384:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788664419.124345:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664419.126654:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c41166b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788664419.126738:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140544384 00000100:00100000:1.0:1788664419.126747:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140544384 00000100:00100000:1.0:1788664419.127035:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788664419.127047:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+5:17122:x1875550140544384:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788664419.127108:0:17138:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788664419.127112:0:17138:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788664419.127114:0:17138:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788664419.127432:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788664419.127977:0:17138:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1788664419.130989:0:17160:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788664419.130998:0:17160:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788664419.131001:0:17160:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788664419.131003:0:17160:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788664419.131587:0:17160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788664419.131866:0:17138:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788664419.131880:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788664419.136836:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+5:17122:x1875550140544384:12345-0@lo:253:mount.lustre.0 Request processed in 9781us (12480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664419.136852:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664419.138334:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140544384:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788664419.138352:0:17122:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788664419.138355:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788664419.138357:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788664419.138359:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664419.138360:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664419.138361:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664419.138362:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664419.138363:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788664419.138365:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788664419.138366:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664419.138367:0:17122:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788664419.138392:0:17122:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c43f740000 from lustre-MDT0000 10000000:01000000:2.0:1788664419.138426:0:17122:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788664419.138429:0:17122:0:(mgc_request.c:327:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788664419.138433:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93c412cacd40 10000000:01000000:2.0:1788664419.138437:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788664419.138445:0:17122:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff93c412cacd40 from 1 10000000:01000000:2.0:1788664419.138448:0:17122:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788664419.138500:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.139607:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.139621:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664419.139649:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140544512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788664419.139714:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664419.139865:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c41166b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788664419.141381:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140544512 00000100:00100000:3.0:1788664419.141396:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140544512 00000100:00100000:3.0:1788664419.141458:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664419.141468:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+5:17122:x1875550140544512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788664419.141487:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664419.142919:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40502a200/0xcd11f61c1413e835 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413e82e expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.142957:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40502a200/0xcd11f61c1413e835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413e82e expref: 6 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.142969:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40502a200/0xcd11f61c1413e835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e82e expref: 6 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.142978:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a200, rc 0) 00000100:00100000:3.0:1788664419.143136:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+6:17122:x1875550140544512:12345-0@lo:101:mount.lustre.0 Request processed in 1667us (3419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664419.143157:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664419.143266:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140544512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788664419.143283:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e835 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.143292:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413e835 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664419.143392:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140544640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664419.143426:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664419.143464:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c41166b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788664419.143716:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140544640 00000100:00100000:3.0:1788664419.143723:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140544640 00000100:00100000:3.0:1788664419.143761:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788664419.143787:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+6:17122:x1875550140544640:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788664419.143884:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+6:17122:x1875550140544640:12345-0@lo:501:mount.lustre.0 Request processed in 115us (457us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788664419.143892:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664419.144486:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140544640:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788664419.144592:0:17122:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788664419.144720:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e835 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.144730:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e835 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664419.144739:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c43f740000 10000000:01000000:0.0:1788664419.144744:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788664419.144749:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93c43f740000 10000000:01000000:0.0:1788664419.144752:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788664419.144755:0:17122:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-barrier-ffff93c43f740000 from 1 10000000:01000000:0.0:1788664419.144758:0:17122:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788664419.144842:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303956400/0xcd11f61c1413e83c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.144851:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303956400/0xcd11f61c1413e83c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.144860:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303956400/0xcd11f61c1413e83c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664419.144892:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140544768:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788664419.144947:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664419.144979:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42ebf30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664419.145072:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140544768 00000100:00100000:3.0:1788664419.145079:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140544768 00000100:00100000:3.0:1788664419.145121:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788664419.145131:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+6:17122:x1875550140544768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788664419.145143:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664419.145156:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40502a800/0xcd11f61c1413e843 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413e83c expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.145176:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40502a800/0xcd11f61c1413e843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413e83c expref: 7 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.145186:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40502a800/0xcd11f61c1413e843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e83c expref: 7 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.145193:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a800, rc 0) 00000100:00100000:3.0:1788664419.145273:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+7:17122:x1875550140544768:12345-0@lo:101:mount.lustre.0 Request processed in 143us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664419.145280:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664419.145918:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140544768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664419.145935:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303956400/0xcd11f61c1413e83c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e843 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.145944:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303956400/0xcd11f61c1413e83c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413e843 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664419.145959:0:17122:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788664419.146011:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303956400/0xcd11f61c1413e83c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e843 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.146030:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303956400/0xcd11f61c1413e83c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e843 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664419.146037:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788664419.146044:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788664419.146049:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93c43f740000 10000000:01000000:0.0:1788664419.146051:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788664419.146055:0:17122:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788664419.146057:0:17122:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788664419.146182:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85200/0xcd11f61c1413e84a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664419.146196:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b85200/0xcd11f61c1413e84a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664419.146205:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b85200/0xcd11f61c1413e84a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664419.146223:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140544896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788664419.146266:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664419.146303:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412d84f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664419.146366:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140544896 00000100:00100000:2.0:1788664419.146372:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140544896 00000100:00100000:2.0:1788664419.146438:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788664419.146446:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+7:17122:x1875550140544896:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788664419.146457:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664419.146469:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4029e2000/0xcd11f61c1413e851 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413e84a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.146497:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e2000/0xcd11f61c1413e851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413e84a expref: 8 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.146505:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4029e2000/0xcd11f61c1413e851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e84a expref: 8 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.146513:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e2000, rc 0) 00000100:00100000:2.0:1788664419.146560:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+8:17122:x1875550140544896:12345-0@lo:101:mount.lustre.0 Request processed in 114us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664419.146567:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664419.146635:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140544896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788664419.146664:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b85200/0xcd11f61c1413e84a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e851 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.146680:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b85200/0xcd11f61c1413e84a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413e851 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664419.146738:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140545024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788664419.146767:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664419.147626:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788664419.147964:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140545024 00000100:00100000:1.0:1788664419.147981:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140545024 00000100:00100000:1.0:1788664419.148016:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788664419.148023:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+8:17122:x1875550140545024:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664419.148232:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+9:17122:x1875550140545024:12345-0@lo:501:mount.lustre.0 Request processed in 209us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664419.148241:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664419.148518:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140545024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788664419.148560:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140545152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788664419.148602:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664419.148994:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788664419.149042:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140545152 00000100:00100000:1.0:1788664419.149047:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140545152 00000100:00100000:1.0:1788664419.149177:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788664419.149186:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+9:17122:x1875550140545152:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788664419.150289:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+9:17122:x1875550140545152:12345-0@lo:503:mount.lustre.0 Request processed in 1098us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664419.150299:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788664419.150515:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140545152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788664419.153396:0:17161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17161:1875550140545280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664419.153481:0:17161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664419.153553:0:17161:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c302ad0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788664419.153599:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140545280 00000100:00100000:0.0:1788664419.153606:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140545280 00000100:00100000:0.0:1788664419.153821:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788664419.153832:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+9:17161:x1875550140545280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664419.155336:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+9:17161:x1875550140545280:12345-0@lo:502:llog_process_th.0 Request processed in 1500us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664419.155348:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788664419.155528:0:17161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17161:1875550140545280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664419.155563:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664419.155575:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664419.155577:0:17161:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788664419.155583:0:17161:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788664419.155585:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788664419.155601:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff93c3028d8000) 00000020:00000080:3.0:1788664419.155616:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788664419.155622:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788664419.155743:0:17161:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788664419.155754:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413e85f 00000020:00000080:3.0:1788664419.155994:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788664419.155999:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664419.156003:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664419.156004:0:17161:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788664419.156007:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664419.156011:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664419.156013:0:17161:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788664419.156016:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788664419.156024:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff93c3028dcd40) 00000020:00000080:3.0:1788664419.156034:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788664419.156038:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788664419.156040:0:17161:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788664419.156042:0:17161:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788664419.156047:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788664419.156105:0:17161:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c43f740000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788664419.156119:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff93c3028d99c0) 00000020:00000080:3.0:1788664419.156127:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788664419.156177:0:17161:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788664419.156182:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd11f61c1413e874 00000020:00000080:3.0:1788664419.156267:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788664419.156274:0:17161:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788664419.156278:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcd11f61c1413e87b 00080000:01000000:3.0:1788664419.156283:0:17161:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788664419.156286:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413e882 00010000:00010000:0.0:1788664419.271217:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788664419.272088:0:17161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967530 00000001:00080000:0.0:1788664419.273079:0:17161:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788664419.275032:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93c412cab380) 00000020:00000080:0.0:1788664419.275127:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788664419.275226:0:17161:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788664419.275234:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413e890 00000020:00000080:0.0:1788664419.279268:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788664419.285466:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcd11f61c1413e897 00000020:00000080:1.0:1788664419.286130:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788664419.286142:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664419.286149:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664419.286151:0:17161:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788664419.286155:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788664419.286158:0:17161:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788664419.286159:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788664419.286161:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788664419.286162:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788664419.286164:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664419.286166:0:17161:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788664419.286168:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664419.286173:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664419.286174:0:17161:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788664419.286178:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788664419.286223:0:17161:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788664419.286241:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664419.286252:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664419.286253:0:17161:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788664419.286257:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664419.286260:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664419.286261:0:17161:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788664419.286264:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788664419.286268:0:17161:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:00000080:1.0:1788664419.286294:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788664419.286309:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff93c4227db380) 00000020:00000080:1.0:1788664419.286325:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788664419.286330:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788664419.286395:0:17161:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788664419.286401:0:17161:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788664419.286407:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413e8a5 00010000:00080000:1.0:1788664419.286438:0:17161:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c403830800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788664419.292535:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788664419.296013:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788664419.296028:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788664419.296076:0:17161:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788664419.296100:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd11f61c1413e8ac 00000100:00080000:2.0:1788664419.296112:0:17161:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788664419.296119:0:17161:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93c403830800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664419.296160:0:17161:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039c9c00 x1875550140545408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788664419.296188:0:17161:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788664419.296262:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664419.296267:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664419.296268:0:17161:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788664419.296271:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788664419.296273:0:17161:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788664419.296275:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788664419.296276:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788664419.296278:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788664419.296280:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664419.296288:0:17161:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788664419.296291:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788664419.296296:0:17161:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788664419.296299:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664419.296300:0:17161:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788664419.296303:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788664419.296306:0:17161:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:2.0:1788664419.296332:0:17161:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788664419.296335:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788664419.296348:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93c302884d40) 00000020:00000080:2.0:1788664419.296358:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788664419.296440:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788664419.296499:0:17161:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788664419.296504:0:17161:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788664419.296509:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413e8ba 00010000:00080000:2.0:1788664419.296549:0:17161:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c40641c800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788664419.298904:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1788664419.302032:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140545408:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788664419.302115:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664419.303093:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140545408 00000100:00100000:2.0:1788664419.303105:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140545408 00000100:00100000:2.0:1788664419.303141:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788664419.303148:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1875550140545408:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788664419.303168:0:17148:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1788664419.323870:0:17161:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788664419.325279:0:17161:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788664419.329636:0:17161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664419.330173:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:0.0:1788664419.342530:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1875550140545408:12345-0@lo:38:llog_process_th.0 Request processed in 39372us (40406us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788664419.342552:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788664419.343256:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c403830800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664419.343263:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788664419.343267:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140545408:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788664419.344441:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788664419.345156:0:17167:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788664419.345162:0:17167:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788664419.353946:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788664419.353964:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788664419.354010:0:17161:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788664419.354030:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd11f61c1413e8c1 00000100:00080000:3.0:1788664419.354054:0:17161:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788664419.354349:0:17161:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93c40641c800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788664419.354385:0:17161:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c4350ffb80 x1875550140545536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788664419.354412:0:17161:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788664419.354487:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140545536:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788664419.354553:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875550140545536 offset 0 length 520: 4 00000020:01000000:3.0:1788664419.354702:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664419.354707:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664419.354709:0:17161:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788664419.354711:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788664419.354714:0:17161:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788664419.354715:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788664419.354717:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788664419.354718:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788664419.354720:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664419.354721:0:17161:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788664419.354724:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788664419.354728:0:17161:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788664419.354730:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664419.354731:0:17161:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788664419.354734:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788664419.354738:0:17161:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:3.0:1788664419.354759:0:17161:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788664419.354762:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788664419.354795:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93c3028db380) 00000020:00000080:3.0:1788664419.354808:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788664419.354824:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788664419.354901:0:17161:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788664419.354907:0:17161:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788664419.354918:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd11f61c1413e8cf 00010000:00080000:3.0:1788664419.354947:0:17161:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c408214800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788664419.355160:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788664419.355234:0:17161:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788664419.355253:0:17161:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788664419.360612:0:17161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788664419.361346:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788664419.361506:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788664419.364629:0:17169:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788664419.364636:0:17169:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788664419.365102:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788664419.365113:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788664419.365148:0:17161:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788664419.365166:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd11f61c1413e8d6 00000100:00080000:1.0:1788664419.365175:0:17161:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788664419.365181:0:17161:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c408214800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788664419.365211:0:17161:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c30480c000 x1875550140545664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788664419.365251:0:17161:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788664419.365294:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664419.365298:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664419.365299:0:17161:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788664419.365302:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664419.365306:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664419.365307:0:17161:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788664419.365310:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788664419.365311:0:17161:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788664419.365314:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664419.365316:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664419.365317:0:17161:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788664419.365319:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664419.365321:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664419.365322:0:17161:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788664419.365325:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788664419.365355:0:17161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17161:1875550140545792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664419.365424:0:17161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664419.365463:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140545792 00000100:00100000:1.0:1788664419.365469:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140545792 00000100:00100000:1.0:1788664419.365507:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788664419.365515:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+9:17161:x1875550140545792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664419.365609:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+9:17161:x1875550140545792:12345-0@lo:502:llog_process_th.0 Request processed in 94us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664419.365617:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788664419.365807:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140545664:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788664419.365843:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875550140545664 offset 0 length 520: 4 00000100:00100000:2.0:1788664419.366179:0:17161:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412d84480 going to sleep for 11 seconds 00000100:00100000:2.0:1788664419.366205:0:17161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17161:1875550140545792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664419.366230:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664419.366237:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664419.366238:0:17161:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788664419.366242:0:17161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788664419.366727:0:17122:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788664419.366752:0:17122:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788664419.366792:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85200/0xcd11f61c1413e84a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e851 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.366804:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b85200/0xcd11f61c1413e84a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e851 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664419.366821:0:17122:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c43f740000 from 1 10000000:01000000:3.0:1788664419.366824:0:17122:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788664419.366855:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40502b600/0xcd11f61c1413e8dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.366863:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c40502b600/0xcd11f61c1413e8dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.366871:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c40502b600/0xcd11f61c1413e8dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664419.366889:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140545920:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788664419.366928:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664419.367716:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403ce8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788664419.369295:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140545920 00000100:00100000:3.0:1788664419.369308:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140545920 00000100:00100000:0.0:1788664419.369414:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788664419.369427:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+9:17122:x1875550140545920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664419.369445:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664419.369470:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303957e00/0xcd11f61c1413e8e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413e8dd expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.369497:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303957e00/0xcd11f61c1413e8e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413e8dd expref: 10 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.369508:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303957e00/0xcd11f61c1413e8e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e8dd expref: 10 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.369518:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957e00, rc 0) 00000100:00100000:0.0:1788664419.369620:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+10:17122:x1875550140545920:12345-0@lo:101:mount.lustre.0 Request processed in 196us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664419.369628:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788664419.369911:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140545920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788664419.369932:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c40502b600/0xcd11f61c1413e8dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e8e4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664419.369954:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c40502b600/0xcd11f61c1413e8dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413e8e4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664419.370516:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140546048:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788664419.370571:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664419.371759:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412d84d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664419.371971:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140546048 00000100:00100000:3.0:1788664419.371980:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140546048 00000100:00100000:0.0:1788664419.372069:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664419.372081:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+10:17122:x1875550140546048:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788664419.372107:0:17137:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788664419.372116:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788664419.372224:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+10:17122:x1875550140546048:12345-0@lo:256:mount.lustre.0 Request processed in 145us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664419.372232:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788664419.372364:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140546048:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788664419.373277:0:17122:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788664419.373297:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40502b600/0xcd11f61c1413e8dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e8e4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664419.373309:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c40502b600/0xcd11f61c1413e8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e8e4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664419.373318:0:17122:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c43f740000 from 1 10000000:01000000:1.0:1788664419.373321:0:17122:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664419.373358:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413e8eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664419.373366:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413e8eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664419.373375:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413e8eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664419.373396:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140546176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788664419.373445:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664419.373478:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412d84d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664419.373843:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140546176 00000100:00100000:0.0:1788664419.373850:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140546176 00000100:00100000:0.0:1788664419.373885:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664419.373893:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+10:17122:x1875550140546176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664419.373905:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664419.373920:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303956c00/0xcd11f61c1413e8f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413e8eb expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.373944:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303956c00/0xcd11f61c1413e8f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413e8eb expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.373954:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303956c00/0xcd11f61c1413e8f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e8eb expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.373962:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956c00, rc 0) 00000100:00100000:0.0:1788664419.374004:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+11:17122:x1875550140546176:12345-0@lo:101:mount.lustre.0 Request processed in 112us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664419.374021:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788664419.374297:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140546176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788664419.374313:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413e8eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e8f2 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664419.374323:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413e8eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413e8f2 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664419.374595:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140546304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664419.375191:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664419.375233:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412d84d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664419.375346:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140546304 00000100:00100000:0.0:1788664419.375352:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140546304 00000100:00100000:0.0:1788664419.375393:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664419.375402:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+11:17122:x1875550140546304:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664419.378595:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+11:17122:x1875550140546304:12345-0@lo:501:mount.lustre.0 Request processed in 3184us (3394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664419.378611:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788664419.381340:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140546304:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788664419.387111:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140546432:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788664419.387206:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664419.387254:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403ce89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664419.387319:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140546432 00000100:00100000:2.0:1788664419.387327:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140546432 00000100:00100000:2.0:1788664419.387396:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788664419.387404:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+11:17122:x1875550140546432:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788664419.387520:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+11:17122:x1875550140546432:12345-0@lo:503:mount.lustre.0 Request processed in 116us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664419.387528:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788664419.387826:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140546432:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788664419.389268:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17171:1875550140546560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664419.389334:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664419.389487:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403ce8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788664419.389545:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140546560 00000100:00100000:1.0:1788664419.389551:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140546560 00000100:00100000:1.0:1788664419.389630:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788664419.389639:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+11:17171:x1875550140546560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664419.391953:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+11:17171:x1875550140546560:12345-0@lo:502:llog_process_th.0 Request processed in 2305us (2609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664419.391969:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788664419.392102:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17171:1875550140546560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664419.392139:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664419.392149:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664419.392151:0:17171:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788664419.392159:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c43f740000 00000020:00000080:3.0:1788664419.392162:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788664419.392169:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664419.392172:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664419.392173:0:17171:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788664419.392176:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664419.392178:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664419.392180:0:17171:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788664419.392183:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c43f740000 00000020:00000080:3.0:1788664419.392185:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788664419.392252:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664419.392256:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664419.392257:0:17171:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788664419.392260:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664419.392273:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664419.392274:0:17171:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788664419.392279:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c43f740000 00000020:00000080:3.0:1788664419.392281:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788664419.392301:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664419.392304:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664419.392306:0:17171:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788664419.392309:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664419.392311:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664419.392312:0:17171:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788664419.392316:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c43f740000 00000020:00000080:3.0:1788664419.392318:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788664419.392369:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17171:1875550140546688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664419.392416:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664419.404869:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403ce8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664419.406501:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140546688 00000100:00100000:2.0:1788664419.406513:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140546688 00000100:00100000:2.0:1788664419.406574:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788664419.406584:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+11:17171:x1875550140546688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664419.406794:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+11:17171:x1875550140546688:12345-0@lo:502:llog_process_th.0 Request processed in 211us (14377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664419.406802:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788664419.407110:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17171:1875550140546688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664419.407147:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664419.407155:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664419.407157:0:17171:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788664419.407161:0:17171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788664419.407844:0:17122:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788664419.407872:0:17122:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788664419.407889:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413e8eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e8f2 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.407901:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413e8eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e8f2 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664419.407979:0:17122:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788664419.407982:0:17122:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff93c43f740000 10000000:01000000:2.0:1788664419.407985:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c43f740000 10000000:01000000:2.0:1788664419.407988:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788664419.407994:0:17122:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c43f740000 from 1 10000000:01000000:2.0:1788664419.407996:0:17122:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788664419.408028:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2600/0xcd11f61c1413e8f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.408036:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4029e2600/0xcd11f61c1413e8f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.408044:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4029e2600/0xcd11f61c1413e8f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664419.408130:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140546816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788664419.408181:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664419.408216:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140546816 00000100:00100000:2.0:1788664419.408221:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140546816 00000100:00100000:2.0:1788664419.408253:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788664419.408260:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+11:17122:x1875550140546816:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788664419.408271:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664419.408282:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4029e2e00/0xcd11f61c1413e900 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413e8f9 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.408302:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e2e00/0xcd11f61c1413e900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413e8f9 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.408322:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4029e2e00/0xcd11f61c1413e900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e8f9 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.408331:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e2e00, rc 0) 00000100:00100000:2.0:1788664419.408425:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17122:x1875550140546816:12345-0@lo:101:mount.lustre.0 Request processed in 100us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664419.408433:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788664419.408481:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4118cca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664419.408497:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140546816:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788664419.408510:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4029e2600/0xcd11f61c1413e8f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e900 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.408518:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2600/0xcd11f61c1413e8f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413e900 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664419.408566:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140546944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664419.408592:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664419.408854:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140546944 00000100:00100000:2.0:1788664419.408858:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140546944 00000100:00100000:2.0:1788664419.409900:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788664419.409914:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17122:x1875550140546944:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664419.410070:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17122:x1875550140546944:12345-0@lo:501:mount.lustre.0 Request processed in 148us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664419.410078:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788664419.424892:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4118cca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664419.424940:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140546944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664419.425019:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140547072:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788664419.429069:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664419.429132:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4118cca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664419.432152:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140547072 00000100:00100000:0.0:1788664419.432168:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140547072 00000100:00100000:0.0:1788664419.433274:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788664419.433289:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4199bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17122:x1875550140547072:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788664419.433501:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4199bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17122:x1875550140547072:12345-0@lo:503:mount.lustre.0 Request processed in 216us (4448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664419.433509:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788664419.440919:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140547072:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788664419.445638:0:17176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17176:1875550140547200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664419.445724:0:17176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664419.445763:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140547200 00000100:00100000:2.0:1788664419.445805:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140547200 00000100:00100000:1.0:1788664419.450235:0:17176:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4087a1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788664419.451835:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788664419.451848:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4199bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17176:x1875550140547200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664419.452504:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4199bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17176:x1875550140547200:12345-0@lo:502:llog_process_th.0 Request processed in 657us (6779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664419.452513:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788664419.452585:0:17176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17176:1875550140547200:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788664419.452656:0:17176:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788664419.452670:0:17176:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93c4227d8000) 00000020:00000080:1.0:1788664419.452688:0:17176:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788664419.452805:0:17176:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c43f740000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788664419.452819:0:17176:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c43f740000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788664419.452822:0:17176:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c43f740000 4 00010000:00080000:1.0:1788664419.452857:0:17176:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c407e1e000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788664419.463332:0:17176:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788664419.464964:0:17176:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788664419.465014:0:17176:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788664419.465029:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcd11f61c1413e90e 00000100:00080000:1.0:1788664419.465039:0:17176:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788664419.465046:0:17176:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93c407e1e000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788664419.466181:0:17176:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c30480df80 x1875550140547328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788664419.466210:0:17176:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788664419.469168:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875550140547328:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788664419.469249:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664419.469280:0:17176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17176:1875550140547456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664419.469338:0:17176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664419.469379:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140547456 00000100:00100000:0.0:1788664419.469386:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140547456 00000100:00100000:1.0:1788664419.469609:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140547328 00000100:00100000:1.0:1788664419.469614:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140547328 00000100:00100000:1.0:1788664419.470233:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664419.470244:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1875550140547328:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788664419.470314:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1875550140547328:12345-0@lo:38:llog_process_th.0 Request processed in 71us (1065us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788664419.470321:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664419.470371:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664419.470379:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c407e1e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788664419.470383:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788664419.470386:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875550140547328:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788664419.472372:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788664419.472390:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4199bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17176:x1875550140547456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664419.472545:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4199bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17176:x1875550140547456:12345-0@lo:502:llog_process_th.0 Request processed in 163us (3207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664419.472553:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788664419.479446:0:17176:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42ebf3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664419.479487:0:17176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17176:1875550140547456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664419.479560:0:17176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17176:1875550140547584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664419.481187:0:17176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664419.481340:0:17176:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c405e52840 going to sleep for 11 seconds 00000100:00100000:2.0:1788664419.485919:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140547584 00000100:00100000:2.0:1788664419.485934:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140547584 00000100:00100000:1.0:1788664419.490393:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788664419.490417:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4199be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17176:x1875550140547584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664419.490606:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4199be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17176:x1875550140547584:12345-0@lo:502:llog_process_th.0 Request processed in 202us (9423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664419.490615:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788664419.490681:0:17176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17176:1875550140547584:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788664419.490714:0:17176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788664419.494261:0:17122:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788664419.494300:0:17122:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788664419.494323:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2600/0xcd11f61c1413e8f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e900 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.494350:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e2600/0xcd11f61c1413e8f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e900 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788664419.494401:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788664419.494414:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788664419.494416:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664419.494417:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664419.494418:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664419.494419:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664419.494421:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788664419.494422:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788664419.494423:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664419.494425:0:17122:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788664419.494429:0:17122:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788664419.494431:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788664419.494432:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788664419.494433:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664419.494434:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664419.494435:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664419.494436:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664419.494437:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788664419.494438:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788664419.494439:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664419.494440:0:17122:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788664419.494469:0:17122:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788664419.494489:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140547712:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788664419.494553:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664419.494590:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4087a19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664419.495616:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140547712 00000100:00100000:2.0:1788664419.495628:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140547712 00000100:00100000:2.0:1788664419.495679:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788664419.495689:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17122:x1875550140547712:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788664419.495718:0:17136:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788664419.495735:0:17136:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788664419.501995:0:17136:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788664419.507150:0:17136:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788664419.508290:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17122:x1875550140547712:12345-0@lo:253:mount.lustre.0 Request processed in 12596us (13729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664419.508302:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788664419.508396:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17122:1875550140547712:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788664419.508419:0:17122:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788664419.508423:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788664419.508426:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788664419.508427:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664419.508428:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664419.508429:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664419.508430:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664419.508439:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788664419.508440:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788664419.508442:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664419.508444:0:17122:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788664419.508459:0:17122:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788664419.515296:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788664419.515304:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788664419.515388:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413e915 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664419.515407:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c303957e00/0xcd11f61c1413e8e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e8dd expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664419.515415:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413e915 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664419.515454:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c303957e00/0xcd11f61c1413e8e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413e8dd expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664419.515469:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c303957e00/0xcd11f61c1413e8e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413e8dd expref: 11 pid: 17137 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664419.515484:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875550140547840:0@lo:104: 00000100:00100000:1.0:1788664419.515614:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664419.515666:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c405e52840 going to sleep for 11 seconds 00000100:00100000:2.0:1788664419.516117:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140547840 00000100:00100000:2.0:1788664419.516125:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140547840 00000100:00100000:2.0:1788664419.516169:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788664419.516178:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+3:17159:x1875550140547840:12345-0@lo:104: 00010000:00010000:2.0:1788664419.516192:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c40502b600/0xcd11f61c1413e8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413e8e4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.516248:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664419.516253:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+3:17159:x1875550140547840:12345-0@lo:104: Request processed in 77us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664419.516260:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788664419.516293:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875550140547840:0@lo:104: 00010000:00010000:2.0:1788664419.516311:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413e915 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.517436:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664419.517445:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c40502b600/0xcd11f61c1413e8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413e8e4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.517457:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664419.517461:0:17132:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c40502b600/0xcd11f61c1413e8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413e8e4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.517485:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c40502b600/0xcd11f61c1413e8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413e8e4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664419.517492:0:17132:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c40502b600/0xcd11f61c1413e8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413e8e4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664419.517498:0:17132:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664419.517540:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c40502b600/0xcd11f61c1413e8dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413e8e4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.517547:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664419.517567:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c40502b600/0xcd11f61c1413e8dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413e8e4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.517574:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c40502b600/0xcd11f61c1413e8dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413e8e4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.517591:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664419.517593:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664419.517594:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664419.517640:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140547968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664419.517689:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664419.522260:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140547968 00000100:00100000:0.0:1788664419.522273:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140547968 00010000:00010000:0.0:1788664419.522306:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c303957e00/0xcd11f61c1413e8e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413e8dd expref: 12 pid: 17137 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664419.522343:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664419.522351:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:3636:x1875550140547968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664419.522370:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664419.522375:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c303957e00/0xcd11f61c1413e8e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413e8dd expref: 12 pid: 17137 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.522387:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c303957e00/0xcd11f61c1413e8e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413e8dd expref: 12 pid: 17137 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.522402:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303957e00/0xcd11f61c1413e8e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413e8dd expref: 12 pid: 17137 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.522427:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413e915 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.522436:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413e915 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788664419.522450:0:17128:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007147744s 00010000:00010000:0.0:1788664419.522455:0:17128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413e915 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.522463:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413e915 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.522470:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413e915 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.522477:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413e915 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.522483:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664419.522487:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413e915 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.522499:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413e915 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.522521:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413e915 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.522531:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664419.522593:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+11:3636:x1875550140547968:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (4903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664419.522600:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664419.522643:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140547968:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664419.522730:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413e915 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.522738:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413e915 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.522745:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413e915 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788664419.530838:0:17122:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788664419.531275:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788664419.531367:0:17182:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788664419.531370:0:17182:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788664419.531604:0:17183:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788664419.532452:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788664419.532611:0:17183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1788664419.533274:0:17184:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff93c30480f100 x1875550140548096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664419.533286:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00000040:00080000:2.0:1788664419.535143:0:17183:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788664419.535224:0:17183:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:3.0:1788664419.536504:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788664419.536547:0:17122:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788664419.537222:0:17122:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788664419.537232:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788664419.537274:0:17122:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788664419.538523:0:17122:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788664419.539317:0:17122:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788664419.539357:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788664419.540579:0:17122:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1788664419.542612:0:17122:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788664419.544276:0:17122:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788664419.544312:0:17122:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaa6d40d4b988 00100000:10000000:3.0:1788664419.544320:0:17122:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788664419.545186:0:17122:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788664419.545201:0:17122:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788664419.545219:0:17122:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788664419.545236:0:17122:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788664419.545991:0:17122:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788664419.546205:0:17122:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788664420.037598:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788664420.490844:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788664420.542972:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 10000000:01000000:3.0:1788664420.606164:0:17140:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788664420.606172:0:17140:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c43f740000 from 7 10000000:01000000:3.0:1788664420.606177:0:17140:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788664420.606221:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40502a400/0xcd11f61c1413e91c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664420.606234:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c40502a400/0xcd11f61c1413e91c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664420.606256:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c40502a400/0xcd11f61c1413e91c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664420.606280:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140548224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664420.606344:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664420.606619:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4060d7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664420.608649:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140548224 00000100:00100000:0.0:1788664420.608662:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140548224 00000100:00100000:0.0:1788664420.608755:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788664420.608764:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+11:17140:x1875550140548224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664420.608795:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664420.608822:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303957800/0xcd11f61c1413e923 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413e91c expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664420.608855:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303957800/0xcd11f61c1413e923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413e91c expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664420.608866:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303957800/0xcd11f61c1413e923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e91c expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664420.608874:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957800, rc 0) 00000100:00100000:0.0:1788664420.608949:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17140:x1875550140548224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (2605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664420.608963:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788664420.609066:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140548224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664420.609085:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c40502a400/0xcd11f61c1413e91c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e923 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664420.609094:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c40502a400/0xcd11f61c1413e91c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413e923 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664420.609156:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140548352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788664420.609193:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664420.609676:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4060d7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788664420.609737:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140548352 00000100:00100000:1.0:1788664420.609743:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140548352 00000100:00100000:1.0:1788664420.609947:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788664420.609958:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17140:x1875550140548352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788664420.609976:0:17137:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788664420.609996:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788664420.609999:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788664420.610192:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17140:x1875550140548352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 236us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664420.610200:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788664420.610281:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140548352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788664420.610322:0:17140:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788664420.610329:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40502a400/0xcd11f61c1413e91c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e923 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664420.610338:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c40502a400/0xcd11f61c1413e91c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e923 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664421.057659:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788664421.507395:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788664421.574153:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00010000:00010000:2.0:1788664422.078176:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664422.608883:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00010000:00010000:1.0:1788664423.101924:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664423.631225:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00010000:00010000:2.0:1788664424.133931:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788664424.524970:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788664424.524978:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788664424.524982:0:36:0:(import.c:65:import_set_state_nolock()) ffff93c403830800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664424.524991:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1788664424.524997:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788664424.525005:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93c403830800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664424.525029:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039c8a80 x1875550140548608/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788664424.525041:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788664424.525045:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788664424.525048:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788664424.525051:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788664424.525053:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788664424.525056:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788664424.525058:0:36:0:(import.c:65:import_set_state_nolock()) ffff93c407e1e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664424.525062:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93c407e1e000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664424.525081:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039caa00 x1875550140548736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664424.525111:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3637:1875550140548480:0@lo:400:kworker.0 00000100:00100000:2.0:1788664424.525178:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664424.525253:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140548480 00000100:00100000:2.0:1788664424.525262:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140548480 00000100:00100000:2.0:1788664424.525307:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788664424.525316:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:3637:x1875550140548480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664424.525363:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:3637:x1875550140548480:12345-0@lo:400:kworker.0 Request processed in 48us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664424.525370:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788664424.525413:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3637:1875550140548480:0@lo:400:kworker.0 00000100:00100000:3.0:1788664424.534389:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140548608:0@lo:38:kworker.0 00000100:00100000:3.0:1788664424.534487:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664424.534540:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140548608 00000100:00100000:3.0:1788664424.534547:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140548608 00000100:00100000:3.0:1788664424.534579:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664424.534587:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1875550140548608:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788664424.534605:0:17149:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788664424.538898:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875550140548736:0@lo:38:kworker.0 00000100:00100000:0.0:1788664424.539172:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664424.555146:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140548736 00000100:00100000:2.0:1788664424.555164:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140548736 00000100:00100000:2.0:1788664424.555206:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664424.555214:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1875550140548736:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788664424.555244:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:2.0:1788664424.555281:0:17145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcd11f61c1413e92a 00000004:00100000:2.0:1788664424.555300:0:17145:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788664424.555437:0:17145:0:(import.c:65:import_set_state_nolock()) ffff93c4352e5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664424.556669:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875550140548736:12345-0@lo:38:kworker.0 Request processed in 1449us (17491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664424.556681:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788664424.565152:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c3039caa00 x1875550140548736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788664424.565176:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788664424.565184:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788664424.565191:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788664424.565194:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c407e1e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788664424.565202:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875550140548736:0@lo:38:kworker.0 00000100:00100000:3.0:1788664424.569245:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1875550140548608:12345-0@lo:38:kworker.0 Request processed in 34648us (34749us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788664424.569259:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788664424.569338:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c403830800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664424.569344:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788664424.569357:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140548608:0@lo:38:kworker.0 00000100:00100000:1.0:1788664424.639840:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00000001:02000400:0.0:1788664424.892296:0:17427:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788664425.154203:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664425.661887:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00000020:00000004:0.0:1788664425.940690:0:17479:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788664425.941250:0:17479:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788664426.178084:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664426.692056:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00000020:00000004:2.0:1788664426.996910:0:17529:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788664426.997122:0:17529:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788664427.208199:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664427.712871:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00010000:00010000:2.0:1788664428.224078:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664428.738001:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00010000:00010000:0.0:1788664429.247020:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788664429.629916:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788664429.629922:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788664429.629926:0:36:0:(import.c:65:import_set_state_nolock()) ffff93c403830800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664429.629934:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1788664429.629940:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788664429.629946:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93c403830800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664429.629968:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039cbb80 x1875550140548992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788664429.629986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788664429.629990:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788664429.629993:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788664429.629997:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788664429.630050:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140548864:0@lo:400:kworker.0 00000100:00100000:2.0:1788664429.630587:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664429.630639:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664429.630647:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140549120:0@lo:400:kworker.0 00000100:00100000:2.0:1788664429.630679:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664429.630762:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140548992:0@lo:38:kworker.0 00000100:00100000:2.0:1788664429.630820:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664429.630868:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140548992 00000100:00100000:2.0:1788664429.630875:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140548992 00000100:00100000:2.0:1788664429.630902:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664429.630909:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1875550140548992:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788664429.630929:0:17148:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788664429.631999:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140548864 00000100:00100000:3.0:1788664429.632008:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140548864 00000100:00100000:3.0:1788664429.632058:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788664429.632069:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:3638:x1875550140548864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664429.632146:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:3638:x1875550140548864:12345-0@lo:400:kworker.0 Request processed in 80us (1560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664429.632153:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788664429.632207:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140548864:0@lo:400:kworker.0 00000100:00100000:0.0:1788664429.632222:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140549120 00000100:00100000:0.0:1788664429.632227:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140549120 00000100:00100000:0.0:1788664429.632263:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664429.632271:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140549120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664429.632312:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140549120:12345-0@lo:400:kworker.0 Request processed in 42us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664429.632318:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788664429.633119:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c3039c9c00 x1875550140549120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664429.633134:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140549120:0@lo:400:kworker.0 00000100:00100000:2.0:1788664429.649427:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1875550140548992:12345-0@lo:38:kworker.0 Request processed in 18510us (18599us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788664429.649442:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788664429.649489:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c403830800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664429.649494:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788664429.649498:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140548992:0@lo:38:kworker.0 00000100:00100000:1.0:1788664429.763753:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00010000:00010000:2.0:1788664430.282247:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664430.655223:0:3635:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664419/real 1788664419] req@ffff93c30480c000 x1875550140545664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664429 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664430.655276:0:3635:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c30480c000 x1875550140545664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664429 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664430.655287:0:3635:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664419/real 1788664419] req@ffff93c4350ffb80 x1875550140545536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664429 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664430.655297:0:3635:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c4350ffb80 x1875550140545536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664429 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788664430.655313:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c408214800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788664430.655338:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788664430.655342:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140545664:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788664430.655348:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c40641c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788664430.655354:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788664430.655357:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140545536:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788664430.656136:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788664430.656141:0:16550:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788664430.656144:0:16550:0:(import.c:65:import_set_state_nolock()) ffff93c403830800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664430.656149:0:16550:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:2.0:1788664430.656155:0:16550:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788664430.656162:0:16550:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93c403830800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664430.656182:0:16550:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039cb800 x1875550140549376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788664430.656197:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788664430.656200:0:16550:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788664430.656202:0:16550:0:(import.c:65:import_set_state_nolock()) ffff93c40641c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664430.656205:0:16550:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1788664430.656207:0:16550:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788664430.656220:0:16550:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93c40641c800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664430.656233:0:16550:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039c8700 x1875550140549504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788664430.656252:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788664430.656254:0:16550:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788664430.656256:0:16550:0:(import.c:65:import_set_state_nolock()) ffff93c408214800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664430.656259:0:16550:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1788664430.656261:0:16550:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788664430.656264:0:16550:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c408214800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664430.656275:0:16550:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039cb480 x1875550140549632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664430.656309:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140549248:0@lo:400:kworker.0 00000100:00100000:2.0:1788664430.656370:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664430.656431:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664430.656437:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140549760:0@lo:400:kworker.0 00000100:00100000:2.0:1788664430.656464:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664430.656499:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140549248 00000100:00100000:2.0:1788664430.656506:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140549248 00000100:00100000:2.0:1788664430.656550:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788664430.656558:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:3636:x1875550140549248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664430.656606:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:3636:x1875550140549248:12345-0@lo:400:kworker.0 Request processed in 48us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664430.656613:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788664430.656642:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140549760 00000100:00100000:2.0:1788664430.656646:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140549760 00000100:00100000:2.0:1788664430.656671:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664430.656688:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140549760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664430.656745:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140549760:12345-0@lo:400:kworker.0 Request processed in 49us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664430.656751:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788664430.656810:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c3039c8000 x1875550140549760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664430.656821:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140549760:0@lo:400:kworker.0 00000100:00100000:2.0:1788664430.656829:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140549248:0@lo:400:kworker.0 00000100:00100000:2.0:1788664430.656850:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140549376:0@lo:38:kworker.0 00000100:00100000:2.0:1788664430.656877:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664430.656895:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140549504:0@lo:8:kworker.0 00000400:00000100:2.0:1788664430.656911:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875550140549504 offset 0 length 520: 4 00000100:00100000:2.0:1788664430.656927:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140549632:0@lo:8:kworker.0 00000400:00000100:2.0:1788664430.657084:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875550140549632 offset 0 length 520: 4 00000100:00100000:2.0:1788664430.657110:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140549376 00000100:00100000:2.0:1788664430.657128:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140549376 00000100:00100000:2.0:1788664430.657150:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664430.657155:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1875550140549376:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788664430.657170:0:17149:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788664430.657217:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1875550140549376:12345-0@lo:38:kworker.0 Request processed in 61us (338us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788664430.657224:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788664430.657248:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c403830800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664430.657252:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788664430.657261:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140549376:0@lo:38:kworker.0 00000100:00100000:1.0:1788664430.782824:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00010000:00010000:1.0:1788664431.310491:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788664431.742359:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788664431.805850:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00010000:00010000:3.0:1788664432.326482:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664432.830844:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00010000:00010000:1.0:1788664433.342067:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664433.854405:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00010000:00010000:3.0:1788664434.365919:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788664434.684766:0:17874:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:3.0:1788664434.685278:0:17874:0:(obd_mount.c:924:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788664434.685280:0:17874:0:(obd_mount.c:927:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788664434.685400:0:17874:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c42f768000 00000020:01000004:3.0:1788664434.685426:0:17874:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788664434.685437:0:17874:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788664434.685452:0:17874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff93c435373380) 00000020:00000080:3.0:1788664434.685470:0:17874:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788664434.779651:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788664434.780103:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.782755:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.784377:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.784684:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.785348:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.785694:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.785931:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.786333:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.786600:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.786815:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.787252:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.787592:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.787914:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.788625:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.788892:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.789217:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.789516:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.789728:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.790117:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.790461:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.790678:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.791120:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.792506:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.792905:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.793346:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.795198:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.796120:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.796589:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.797133:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.797489:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.797684:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.800578:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788664434.802399:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788664434.803112:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788664434.805096:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788664434.806861:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788664434.807498:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788664434.808305:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788664434.808878:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788664434.810056:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788664434.811666:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788664434.814900:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788664434.815322:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788664434.815603:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788664434.818848:0:17874:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:01000000:0.0:1788664434.827439:0:17874:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788664434.828657:0:17874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788664434.828671:0:17874:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788664434.828688:0:17874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd11f61c1413e938 00000020:01000004:0.0:1788664434.828696:0:17874:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788664434.828731:0:17874:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788664434.828735:0:17874:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788664434.828754:0:17874:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788664434.828819:0:17874:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788664434.828824:0:17874:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788664434.845366:0:17874:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788664434.845427:0:17874:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1788664434.845431:0:17874:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788664434.845433:0:17874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788664434.845434:0:17874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664434.845435:0:17874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664434.845437:0:17874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664434.845443:0:17874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664434.845445:0:17874:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788664434.845446:0:17874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664434.845448:0:17874:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788664434.845451:0:17874:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1788664434.845453:0:17874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788664434.845454:0:17874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788664434.845455:0:17874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664434.845456:0:17874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664434.845457:0:17874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664434.845458:0:17874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664434.845459:0:17874:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788664434.845460:0:17874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664434.845461:0:17874:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788664434.845488:0:17874:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788664434.845508:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140549888:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788664434.845608:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664434.845722:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406b8c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664434.846936:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140549888 00000100:00100000:2.0:1788664434.846950:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140549888 00000100:00100000:2.0:1788664434.847228:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788664434.847238:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17874:x1875550140549888:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788664434.847271:0:17137:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788664434.847274:0:17137:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788664434.847281:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788664434.847700:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17874:x1875550140549888:12345-0@lo:253:mount.lustre.0 Request processed in 462us (2091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664434.847719:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788664434.847855:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140549888:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788664434.847869:0:17874:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788664434.847872:0:17874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788664434.847874:0:17874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788664434.847875:0:17874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664434.847876:0:17874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664434.847878:0:17874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664434.847879:0:17874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664434.847880:0:17874:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788664434.847882:0:17874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664434.847883:0:17874:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788664434.847905:0:17874:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c42f768000 from lustre-MDT0001 10000000:01000000:1.0:1788664434.847937:0:17874:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788664434.847940:0:17874:0:(mgc_request.c:327:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788664434.847946:0:17874:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93c412cacd40 local copy 00010000:00010000:1.0:1788664434.848019:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e835 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664434.848350:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664434.848389:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664434.848420:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406b8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788664434.848487:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140550016 00000100:00100000:3.0:1788664434.848492:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140550016 00000100:00100000:3.0:1788664434.848616:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788664434.848625:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17874:x1875550140550016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788664434.848696:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17874:x1875550140550016:12345-0@lo:501:mount.lustre.0 Request processed in 72us (306us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788664434.848703:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788664434.848852:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550016:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788664434.848865:0:17874:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788664434.848883:0:17874:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788664434.848889:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e835 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664434.848898:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e835 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664434.848924:0:17874:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c42f768000 10000000:01000000:1.0:1788664434.848929:0:17874:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788664434.848933:0:17874:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93c412cacd40 10000000:01000000:1.0:1788664434.848936:0:17874:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788664434.848939:0:17874:0:(mgc_request.c:1800:mgc_process_log()) Process log nodemap-ffff93c412cacd40 from 1 10000000:01000000:1.0:1788664434.848943:0:17874:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788664434.849062:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84800/0xcd11f61c1413e93f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664434.849080:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b84800/0xcd11f61c1413e93f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664434.849090:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b84800/0xcd11f61c1413e93f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664434.849115:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788664434.849144:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664434.849166:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406b8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788664434.849270:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140550144 00000100:00100000:3.0:1788664434.849274:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140550144 00000100:00100000:3.0:1788664434.849307:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788664434.849314:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+12:17874:x1875550140550144:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788664434.849323:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664434.849337:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40502a000/0xcd11f61c1413e946 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413e93f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664434.849359:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40502a000/0xcd11f61c1413e946 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413e93f expref: 13 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664434.849371:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40502a000/0xcd11f61c1413e946 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e93f expref: 13 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664434.849380:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502a000, rc 0) 00000100:00100000:3.0:1788664434.849419:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+13:17874:x1875550140550144:12345-0@lo:101:mount.lustre.0 Request processed in 106us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664434.849426:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788664434.849495:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788664434.849508:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b84800/0xcd11f61c1413e93f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e946 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664434.849517:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b84800/0xcd11f61c1413e93f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413e946 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664434.849531:0:17874:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788664434.849556:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84800/0xcd11f61c1413e93f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e946 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664434.849563:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b84800/0xcd11f61c1413e93f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e946 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664434.849570:0:17874:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93c42f768000 10000000:01000000:1.0:1788664434.849573:0:17874:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788664434.849576:0:17874:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-barrier-ffff93c42f768000 from 1 10000000:01000000:1.0:1788664434.849579:0:17874:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788664434.849592:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413e94d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664434.849599:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413e94d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664434.849606:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413e94d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664434.849624:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788664434.849648:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664434.849668:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406b8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788664434.849808:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140550272 00000100:00100000:3.0:1788664434.849812:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140550272 00000100:00100000:3.0:1788664434.849836:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788664434.849842:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+13:17874:x1875550140550272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788664434.849849:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664434.849857:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40502b600/0xcd11f61c1413e954 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413e94d expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664434.849869:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40502b600/0xcd11f61c1413e954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413e94d expref: 14 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664434.849876:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40502b600/0xcd11f61c1413e954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e94d expref: 14 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664434.849888:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502b600, rc 0) 00000100:00100000:3.0:1788664434.849919:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+14:17874:x1875550140550272:12345-0@lo:101:mount.lustre.0 Request processed in 77us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664434.849924:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788664434.850433:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788664434.850447:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413e94d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e954 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664434.850455:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413e94d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413e954 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664434.850467:0:17874:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788664434.850483:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413e94d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e954 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664434.850491:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b84e00/0xcd11f61c1413e94d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e954 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664434.850497:0:17874:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788664434.850501:0:17874:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788664434.850505:0:17874:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93c42f768000 10000000:01000000:1.0:1788664434.850508:0:17874:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788664434.850511:0:17874:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788664434.850513:0:17874:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788664434.850529:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413e95b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664434.850546:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413e95b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664434.850562:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413e95b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664434.850576:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788664434.850607:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664434.850639:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406b8c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788664434.850805:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140550400 00000100:00100000:0.0:1788664434.850811:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140550400 00000100:00100000:0.0:1788664434.850837:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788664434.850845:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+14:17874:x1875550140550400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664434.850853:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664434.850862:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303956800/0xcd11f61c1413e962 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413e95b expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664434.850879:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303956800/0xcd11f61c1413e962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413e95b expref: 15 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664434.850888:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303956800/0xcd11f61c1413e962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e95b expref: 15 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664434.850895:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956800, rc 0) 00000100:00100000:0.0:1788664434.850931:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+15:17874:x1875550140550400:12345-0@lo:101:mount.lustre.0 Request processed in 87us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664434.850937:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788664434.851217:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788664434.851228:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413e95b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e962 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664434.851237:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413e95b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413e962 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788664434.852470:0:17874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1788664434.853517:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664434.862413:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788664434.862475:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788664434.862490:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788664434.862503:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788664434.862515:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1788664434.862527:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1788664434.862556:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1788664434.862572:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788664434.862586:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788664434.862600:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1788664434.862613:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1788664434.862626:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1788664434.862637:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1788664434.862650:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788664434.862678:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788664434.862695:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1788664434.862722:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788664434.862737:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788664434.862749:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1788664434.862760:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788664434.862949:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788664434.863082:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788664434.863098:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788664434.863127:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1788664434.863133:0:17874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1788664434.863240:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664434.863307:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664434.863356:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406b8c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664434.863521:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140550528 00000100:00100000:2.0:1788664434.863530:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140550528 00000100:00100000:2.0:1788664434.863597:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788664434.863608:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+15:17874:x1875550140550528:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664434.863803:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+15:17874:x1875550140550528:12345-0@lo:501:mount.lustre.0 Request processed in 196us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664434.863812:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788664434.864105:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664434.864151:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788664434.864202:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664434.864234:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406b8c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664434.864296:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140550656 00000100:00100000:2.0:1788664434.864301:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140550656 00000100:00100000:2.0:1788664434.864339:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788664434.864348:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+15:17874:x1875550140550656:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788664434.865350:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+15:17874:x1875550140550656:12345-0@lo:503:mount.lustre.0 Request processed in 1001us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664434.865360:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788664434.865529:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550656:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788664434.866247:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788664434.866326:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664434.866379:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664434.866459:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406b8c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788664434.866650:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140550784 00000100:00100000:0.0:1788664434.866657:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140550784 00000100:00100000:0.0:1788664434.866701:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788664434.866720:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+15:17874:x1875550140550784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664434.867506:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+15:17874:x1875550140550784:12345-0@lo:502:mount.lustre.0 Request processed in 793us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664434.867515:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788664434.867956:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550784:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788664434.869103:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788664434.869138:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1788664434.869156:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1788664434.869169:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1788664434.869181:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1788664434.869196:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1788664434.869208:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1788664434.869226:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1788664434.869240:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1788664434.869253:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1788664434.869266:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1788664434.869278:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1788664434.869291:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1788664434.869304:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1788664434.869317:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1788664434.869328:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1788664434.869340:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1788664434.869353:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1788664434.869366:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1788664434.869380:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1788664434.869391:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1788664434.869403:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1788664434.869415:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1788664434.869430:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1788664434.869444:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1788664434.869457:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1788664434.869480:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1788664434.869495:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1788664434.869508:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1788664434.869520:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1788664434.869534:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1788664434.869621:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1788664434.869636:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1788664434.869649:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1788664434.869661:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1788664434.869674:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1788664434.869686:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1788664434.869699:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1788664434.869724:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1788664434.869739:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1788664434.869749:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1788664434.869761:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1788664434.869804:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1788664434.869820:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1788664434.869866:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788664434.869944:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664434.869986:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412d84480 going to sleep for 11 seconds 00000100:00100000:0.0:1788664434.870198:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140550912 00000100:00100000:0.0:1788664434.870212:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140550912 00000100:00100000:0.0:1788664434.870270:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788664434.870280:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c403ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+15:17874:x1875550140550912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664434.870405:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c403ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+15:17874:x1875550140550912:12345-0@lo:502:mount.lustre.0 Request processed in 126us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664434.870413:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788664434.870758:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140550912:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788664434.870848:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1788664434.870858:0:17874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788664434.872212:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664434.872226:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664434.872228:0:17878:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788664434.872234:0:17878:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788664434.872237:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788664434.872251:0:17878:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff93c302883380) 00000020:00000080:2.0:1788664434.872275:0:17878:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788664434.872288:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788664434.872361:0:17878:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788664434.872368:0:17878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd11f61c1413e970 00000020:00000080:2.0:1788664434.872691:0:17878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788664434.872696:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664434.872700:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664434.872701:0:17878:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788664434.872704:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664434.872720:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664434.872722:0:17878:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788664434.872726:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788664434.872734:0:17878:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff93c3028819c0) 00000020:00000080:2.0:1788664434.872744:0:17878:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788664434.872747:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788664434.872749:0:17878:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788664434.872751:0:17878:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788664434.872756:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788664434.872837:0:17878:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c42f768000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788664434.872850:0:17878:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff93c422744d40) 00000020:00000080:2.0:1788664434.872859:0:17878:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788664434.872919:0:17878:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788664434.872925:0:17878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd11f61c1413e985 00000020:00000080:2.0:1788664434.873291:0:17878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788664434.873299:0:17878:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788664434.873304:0:17878:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xcd11f61c1413e98c 00080000:01000000:2.0:1788664434.873310:0:17878:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788664434.873313:0:17878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd11f61c1413e993 00000100:00100000:1.0:1788664434.877835:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00010000:00010000:1.0:1788664434.990346:0:17878:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788664434.991760:0:17878:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1788664434.992353:0:17878:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788664434.993750:0:17878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788664434.993790:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664434.993798:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664434.993800:0:17878:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788664434.993805:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664434.993811:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664434.993813:0:17878:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788664434.993815:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788664434.993821:0:17878:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:00000080:1.0:1788664434.993848:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788664434.993863:0:17878:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff93c4227dcd40) 00000020:00000080:1.0:1788664434.993886:0:17878:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788664434.993893:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788664434.993971:0:17878:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788664434.993977:0:17878:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788664434.993984:0:17878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd11f61c1413e9a1 00010000:00080000:1.0:1788664434.994016:0:17878:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c42e87b000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788664435.002697:0:17878:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788664435.005715:0:17878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788664435.005732:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788664435.005798:0:17878:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788664435.005823:0:17878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd11f61c1413e9a8 00000100:00080000:0.0:1788664435.005833:0:17878:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788664435.005838:0:17878:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93c42e87b000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788664435.005874:0:17878:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3035a6300 x1875550140551040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788664435.005897:0:17878:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788664435.006067:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140551040:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788664435.006158:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664435.006237:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140551040 00000100:00100000:2.0:1788664435.006244:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140551040 00000100:00100000:2.0:1788664435.006272:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788664435.006279:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1875550140551040:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788664435.006312:0:17149:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:2.0:1788664435.006343:0:17149:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd11f61c1413e9af 00000004:00100000:2.0:1788664435.006358:0:17149:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788664435.006364:0:17149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788664435.006585:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788664435.006591:0:16550:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788664435.006594:0:16550:0:(import.c:65:import_set_state_nolock()) ffff93c403830800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788664435.006599:0:16550:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 525 00000100:00080000:1.0:1788664435.006603:0:16550:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788664435.006607:0:16550:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93c403830800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788664435.006640:0:16550:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c30480dc00 x1875550140551168/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788664435.006661:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664435.006665:0:16550:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664435.006667:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664435.006675:0:16550:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788664435.006763:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664435.006795:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664435.006797:0:17878:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788664435.006801:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788664435.006804:0:17878:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788664435.006805:0:17878:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788664435.006807:0:17878:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788664435.006808:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788664435.006811:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664435.006813:0:17878:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788664435.006815:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788664435.006820:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664435.006821:0:17878:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788664435.006825:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788664435.006866:0:17878:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788664435.006895:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664435.006898:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664435.006899:0:17878:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788664435.006902:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788664435.006903:0:17878:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788664435.006905:0:17878:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788664435.006906:0:17878:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788664435.006908:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788664435.006910:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664435.006911:0:17878:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788664435.006914:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788664435.006917:0:17878:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788664435.006920:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664435.006922:0:17878:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788664435.006925:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788664435.006928:0:17878:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:0.0:1788664435.006951:0:17878:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788664435.006953:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788664435.007068:0:17878:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff93c412ca8000) 00000020:00000080:0.0:1788664435.007082:0:17878:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788664435.007088:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788664435.007142:0:17878:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788664435.007149:0:17878:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788664435.007154:0:17878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd11f61c1413e9bd 00010000:00080000:0.0:1788664435.007180:0:17878:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c3041b1000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.152@tcp at head 00000100:00100000:2.0:1788664435.007301:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664435.007313:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140551296:0@lo:400:kworker.0 00000100:00100000:2.0:1788664435.007356:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664435.007401:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140551296 00000100:00100000:2.0:1788664435.007406:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140551296 00000100:00100000:2.0:1788664435.007443:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664435.007450:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140551296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664435.007498:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140551296:12345-0@lo:400:kworker.0 Request processed in 48us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664435.007504:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788664435.007549:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c30480f480 x1875550140551296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664435.007562:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140551296:0@lo:400:kworker.0 00000100:00100000:2.0:1788664435.007585:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140551168:0@lo:38:kworker.0 00000100:00100000:2.0:1788664435.007610:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664435.007638:0:17148:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788664435.007644:0:17148:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788664435.008315:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140551168 00000100:00100000:2.0:1788664435.008320:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140551168 00000100:00100000:1.0:1788664435.008476:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788664435.008482:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3635:x1875550140551168:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788664435.008553:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3635:x1875550140551168:12345-0@lo:38:kworker.0 Request processed in 71us (942us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788664435.008561:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788664435.008651:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788664435.008658:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c403830800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664435.008662:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788664435.008672:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140551168:0@lo:38:kworker.0 00010000:00010000:0.0:1788664435.009062:0:17878:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1788664435.014002:0:17878:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788664435.014237:0:17878:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788664435.015859:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788664435.016526:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788664435.016883:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1788664435.018000:0:17884:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788664435.018007:0:17884:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788664435.018865:0:17878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788664435.018878:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788664435.018918:0:17878:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788664435.018941:0:17878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd11f61c1413e9c4 00000100:00080000:1.0:1788664435.018951:0:17878:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788664435.018958:0:17878:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93c3041b1000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788664435.018993:0:17878:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c30480ed80 x1875550140551424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788664435.019019:0:17878:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788664435.019046:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664435.019051:0:16550:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664435.019053:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664435.019056:0:16550:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788664435.019102:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664435.019107:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664435.019109:0:17878:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788664435.019111:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788664435.019114:0:17878:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788664435.019115:0:17878:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788664435.019117:0:17878:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788664435.019126:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788664435.019129:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664435.019130:0:17878:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788664435.019133:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788664435.019137:0:17878:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788664435.019141:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664435.019142:0:17878:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788664435.019145:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788664435.019149:0:17878:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:1.0:1788664435.019172:0:17878:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788664435.019175:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:3.0:1788664435.019316:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140551424:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788664435.019368:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875550140551424 offset 0 length 520: 4 00000020:00000080:1.0:1788664435.020452:0:17878:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff93c406ebb380) 00000020:00000080:1.0:1788664435.020479:0:17878:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788664435.020490:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:1.0:1788664435.022370:0:17149:0:(import.c:65:import_set_state_nolock()) ffff93c435285000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664435.022460:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3635:x1875550140551040:12345-0@lo:38:llog_process_th.0 Request processed in 16178us (16299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664435.022470:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788664435.022716:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788664435.022726:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788664435.022733:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788664435.022739:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788664435.022742:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c42e87b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788664435.022758:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140551040:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788664435.023046:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140551552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788664435.023110:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664435.023379:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140551552 00000100:00100000:1.0:1788664435.023385:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140551552 00000100:00100000:1.0:1788664435.023425:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788664435.023434:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875550140551552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664435.023462:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788664435.023561:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875550140551552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664435.023568:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788664435.023759:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140551552:0@lo:41:osp-pre-0-1.0 00000004:00080000:2.0:1788664435.024265:0:17878:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788664435.024273:0:17878:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788664435.024282:0:17878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd11f61c1413e9d2 00010000:00080000:2.0:1788664435.024332:0:17878:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c30256e800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788664435.024870:0:17878:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788664435.024942:0:17878:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788664435.024966:0:17878:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788664435.027212:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788664435.029371:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788664435.029579:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788664435.030483:0:17886:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788664435.030488:0:17886:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788664435.031445:0:17878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788664435.031457:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788664435.031497:0:17878:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788664435.031519:0:17878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd11f61c1413e9d9 00000100:00080000:2.0:1788664435.031529:0:17878:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788664435.031750:0:17878:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93c30256e800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664435.031823:0:17878:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039c9f80 x1875550140551680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788664435.031849:0:17878:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788664435.031905:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664435.031909:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664435.031911:0:17878:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788664435.031914:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664435.031918:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664435.031920:0:17878:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788664435.031923:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788664435.031924:0:17878:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788664435.031927:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664435.031929:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664435.031930:0:17878:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788664435.031932:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664435.031941:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664435.031943:0:17878:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788664435.031947:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00080000:1.0:1788664435.032053:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664435.032059:0:16550:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664435.032061:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664435.032072:0:16550:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788664435.032133:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664435.032138:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664435.032139:0:17878:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788664435.032143:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1788664435.032362:0:17874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788664435.032399:0:17874:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788664435.032419:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413e95b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e962 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664435.032430:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b85e00/0xcd11f61c1413e95b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e962 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664435.032440:0:17874:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c42f768000 from 1 10000000:01000000:1.0:1788664435.032443:0:17874:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788664435.032471:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413e9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664435.032480:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413e9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664435.032492:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413e9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664435.032515:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140551808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788664435.032600:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664435.032635:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c41237c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788664435.032656:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140551808 00000100:00100000:1.0:1788664435.032662:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140551808 00000100:00100000:1.0:1788664435.032702:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788664435.032721:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c403ec5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+15:17874:x1875550140551808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788664435.032736:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664435.032758:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303b85600/0xcd11f61c1413e9e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413e9e0 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664435.032811:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303b85600/0xcd11f61c1413e9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413e9e0 expref: 16 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664435.032824:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303b85600/0xcd11f61c1413e9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e9e0 expref: 16 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664435.032833:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85600, rc 0) 00000100:00100000:1.0:1788664435.032872:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c403ec5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+16:17874:x1875550140551808:12345-0@lo:101:mount.lustre.0 Request processed in 153us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664435.032880:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788664435.032928:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140551808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788664435.032942:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413e9e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e9e7 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664435.032950:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413e9e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413e9e7 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664435.036468:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140551936:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788664435.036743:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140551680:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788664435.036801:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875550140551680 offset 0 length 520: 4 00000100:00100000:1.0:1788664435.037802:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664435.037833:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c41237c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788664435.038392:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140551936 00000100:00100000:3.0:1788664435.038403:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140551936 00000100:00100000:3.0:1788664435.038454:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788664435.038463:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c403ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+16:17874:x1875550140551936:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788664435.038490:0:17136:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788664435.038515:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788664435.038518:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788664435.038652:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c403ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+16:17874:x1875550140551936:12345-0@lo:256:mount.lustre.0 Request processed in 189us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664435.038660:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788664435.041153:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140551936:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788664435.041843:0:17874:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788664435.041865:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413e9e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e9e7 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664435.041877:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413e9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e9e7 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664435.041885:0:17874:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c42f768000 from 1 10000000:01000000:0.0:1788664435.041887:0:17874:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788664435.041922:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303956e00/0xcd11f61c1413e9ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664435.041929:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303956e00/0xcd11f61c1413e9ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664435.041938:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303956e00/0xcd11f61c1413e9ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664435.042658:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788664435.042742:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664435.042914:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3038a1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664435.043214:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140552064 00000100:00100000:2.0:1788664435.043223:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140552064 00000100:00100000:2.0:1788664435.043315:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788664435.043325:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c403ec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+16:17874:x1875550140552064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788664435.043341:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664435.043354:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4029e2800/0xcd11f61c1413e9f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413e9ee expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.043378:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e2800/0xcd11f61c1413e9f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413e9ee expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.043388:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4029e2800/0xcd11f61c1413e9f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e9ee expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.043396:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e2800, rc 0) 00000100:00100000:2.0:1788664435.043445:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c403ec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17874:x1875550140552064:12345-0@lo:101:mount.lustre.0 Request processed in 121us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664435.043451:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788664435.043519:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664435.043547:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303956e00/0xcd11f61c1413e9ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e9f5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664435.043555:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303956e00/0xcd11f61c1413e9ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413e9f5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788664435.043692:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788664435.043738:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664435.043763:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664435.044438:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3038a1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664435.045904:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140552192 00000100:00100000:3.0:1788664435.045918:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140552192 00000100:00100000:3.0:1788664435.045981:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788664435.045990:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c403ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17874:x1875550140552192:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788664435.046175:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c403ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17874:x1875550140552192:12345-0@lo:501:mount.lustre.0 Request processed in 185us (2410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664435.046183:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788664435.046343:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664435.046395:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788664435.046445:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664435.046480:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664435.046752:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140552320 00000100:00100000:3.0:1788664435.046758:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140552320 00000100:00100000:3.0:1788664435.046814:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788664435.046822:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17874:x1875550140552320:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788664435.046910:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17874:x1875550140552320:12345-0@lo:503:mount.lustre.0 Request processed in 88us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664435.046918:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788664435.047205:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552320:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788664435.048474:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788664435.048559:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552448:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788664435.049421:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664435.049471:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664435.049765:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140552448 00000100:00100000:1.0:1788664435.049792:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140552448 00000100:00100000:1.0:1788664435.049852:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788664435.049862:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17874:x1875550140552448:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664435.050063:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17874:x1875550140552448:12345-0@lo:502:mount.lustre.0 Request processed in 202us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664435.050076:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788664435.050192:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552448:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788664435.050483:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788664435.050515:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1788664435.050530:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1788664435.050543:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1788664435.050557:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1788664435.050580:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1788664435.051176:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1788664435.051197:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1788664435.051211:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788664435.051794:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1788664435.051825:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1788664435.051870:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788664435.052231:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664435.052272:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4060d73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664435.053715:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140552576 00000100:00100000:2.0:1788664435.053728:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140552576 00000100:00100000:2.0:1788664435.053801:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788664435.053812:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17874:x1875550140552576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788664435.053950:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17874:x1875550140552576:12345-0@lo:502:mount.lustre.0 Request processed in 140us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664435.053956:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788664435.054114:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788664435.054187:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788664435.054201:0:17874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788664435.055424:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664435.055437:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664435.055439:0:17888:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788664435.055447:0:17888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c42f768000 00000020:00000080:1.0:1788664435.055450:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788664435.055457:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664435.055460:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664435.055461:0:17888:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788664435.055463:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664435.055465:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664435.055466:0:17888:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788664435.055469:0:17888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c42f768000 00000020:00000080:1.0:1788664435.055471:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788664435.055523:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664435.055527:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664435.055528:0:17888:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788664435.055531:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664435.055534:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664435.055535:0:17888:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788664435.055610:0:17888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c42f768000 00000020:00000080:1.0:1788664435.055614:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788664435.055633:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664435.055636:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664435.055638:0:17888:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788664435.055640:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664435.055643:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664435.055644:0:17888:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788664435.055647:0:17888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c42f768000 00000020:00000080:1.0:1788664435.055649:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788664435.055671:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664435.055673:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664435.055684:0:17888:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788664435.055687:0:17888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1788664435.056103:0:17874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788664435.056133:0:17874:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788664435.056149:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303956e00/0xcd11f61c1413e9ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e9f5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664435.056161:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303956e00/0xcd11f61c1413e9ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e9f5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664435.056244:0:17874:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788664435.056248:0:17874:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff93c42f768000 10000000:01000000:0.0:1788664435.056250:0:17874:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c42f768000 10000000:01000000:0.0:1788664435.056255:0:17874:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788664435.056260:0:17874:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c42f768000 from 1 10000000:01000000:0.0:1788664435.056262:0:17874:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788664435.056298:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303956600/0xcd11f61c1413e9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664435.056317:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303956600/0xcd11f61c1413e9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664435.056328:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303956600/0xcd11f61c1413e9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664435.056354:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788664435.056421:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664435.056471:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3038a1900 going to sleep for 11 seconds 00000100:00100000:1.0:1788664435.056835:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140552704 00000100:00100000:1.0:1788664435.056842:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140552704 00000100:00100000:1.0:1788664435.056928:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788664435.056939:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17874:x1875550140552704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788664435.056954:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664435.056968:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303b85000/0xcd11f61c1413ea03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413e9fc expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664435.056992:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303b85000/0xcd11f61c1413ea03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413e9fc expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664435.057002:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303b85000/0xcd11f61c1413ea03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e9fc expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664435.057011:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85000, rc 0) 00000100:00100000:1.0:1788664435.057069:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17874:x1875550140552704:12345-0@lo:101:mount.lustre.0 Request processed in 132us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664435.057075:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788664435.057201:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788664435.057216:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303956600/0xcd11f61c1413e9fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea03 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664435.057280:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303956600/0xcd11f61c1413e9fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413ea03 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788664435.058691:0:17874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788664435.059173:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788664435.059443:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788664435.059469:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788664435.059482:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788664435.059493:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788664435.059508:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788664435.059521:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788664435.059676:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788664435.059697:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788664435.059723:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788664435.059736:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788664435.059747:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788664435.059759:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788664435.060017:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788664435.060035:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788664435.060045:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788664435.060054:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788664435.060064:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788664435.060075:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788664435.060187:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788664435.060206:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788664435.060217:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788664435.060291:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788664435.060304:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788664435.060315:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788664435.060326:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788664435.060337:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788664435.060348:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788664435.060359:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788664435.060376:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788664435.060392:0:17874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788664435.060471:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788664435.060526:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664435.060766:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4060d7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788664435.060893:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140552832 00000100:00100000:0.0:1788664435.060901:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140552832 00000100:00100000:0.0:1788664435.061097:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788664435.061106:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17874:x1875550140552832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664435.061280:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17874:x1875550140552832:12345-0@lo:501:mount.lustre.0 Request processed in 175us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664435.061287:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788664435.061416:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788664435.061452:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788664435.061495:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664435.061563:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4060d7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788664435.061724:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140552960 00000100:00100000:0.0:1788664435.061729:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140552960 00000100:00100000:0.0:1788664435.061765:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788664435.061789:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17874:x1875550140552960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788664435.061877:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17874:x1875550140552960:12345-0@lo:503:mount.lustre.0 Request processed in 106us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664435.061885:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788664435.061926:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140552960:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788664435.062654:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788664435.062742:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140553088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664435.062803:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664435.062831:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140553088 00000100:00100000:0.0:1788664435.062835:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140553088 00000100:00100000:0.0:1788664435.062901:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788664435.062909:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17874:x1875550140553088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664435.063061:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17874:x1875550140553088:12345-0@lo:502:mount.lustre.0 Request processed in 151us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664435.063068:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788664435.063164:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3038a1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788664435.063179:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140553088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788664435.063403:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788664435.063426:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1788664435.063438:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1788664435.063449:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1788664435.063462:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1788664435.063474:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1788664435.063485:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1788664435.063496:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1788664435.063506:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1788664435.063517:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1788664435.063701:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1788664435.063728:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1788664435.063739:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1788664435.063749:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1788664435.063758:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1788664435.063836:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1788664435.063862:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1788664435.063879:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1788664435.063911:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1788664435.063928:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1788664435.063944:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1788664435.063972:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1788664435.064038:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1788664435.064056:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1788664435.064067:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1788664435.064078:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1788664435.064106:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1788664435.064122:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1788664435.064134:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1788664435.064145:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1788664435.064249:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1788664435.064272:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1788664435.064286:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1788664435.064299:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1788664435.064310:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1788664435.064322:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1788664435.064333:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1788664435.064344:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1788664435.064356:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1788664435.064367:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1788664435.064378:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1788664435.064391:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1788664435.064417:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1788664435.064434:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1788664435.064448:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1788664435.064461:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1788664435.064474:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1788664435.064489:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1788664435.064531:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140553216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664435.064601:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664435.064633:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3038a1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788664435.066065:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140553216 00000100:00100000:3.0:1788664435.066077:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140553216 00000100:00100000:3.0:1788664435.066128:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788664435.066137:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17874:x1875550140553216:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788664435.070517:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17874:x1875550140553216:12345-0@lo:502:mount.lustre.0 Request processed in 4370us (5905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664435.070533:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788664435.074306:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140553216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788664435.078063:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1788664435.078125:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1788664435.078176:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140553344:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664435.078262:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664435.078311:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c419b26f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664435.078466:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140553344 00000100:00100000:2.0:1788664435.078474:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140553344 00000100:00100000:2.0:1788664435.078532:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788664435.078552:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17874:x1875550140553344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788664435.078672:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17874:x1875550140553344:12345-0@lo:502:mount.lustre.0 Request processed in 122us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664435.078686:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788664435.078758:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140553344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788664435.078851:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1788664435.078861:0:17874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788664435.081067:0:17892:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788664435.081082:0:17892:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff93c406eb99c0) 00000020:00000080:1.0:1788664435.081106:0:17892:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788664435.081198:0:17892:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c42f768000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788664435.081203:0:17892:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c42f768000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788664435.081205:0:17892:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c42f768000 3 00010000:00080000:1.0:1788664435.081337:0:17892:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c40392d000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788664435.091297:0:17892:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788664435.091567:0:17892:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788664435.091615:0:17892:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788664435.091632:0:17892:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xcd11f61c1413ea11 00000100:00080000:1.0:1788664435.091643:0:17892:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788664435.091650:0:17892:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93c40392d000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788664435.091688:0:17892:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c30480e680 x1875550140553472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788664435.091725:0:17892:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788664435.091751:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664435.091754:0:16550:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664435.091757:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664435.091759:0:16550:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788664435.093365:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875550140553472:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788664435.093451:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664435.094219:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140553472 00000100:00100000:2.0:1788664435.094610:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140553472 00000100:00100000:2.0:1788664435.094654:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664435.094662:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1875550140553472:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788664435.094691:0:17144:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:2.0:1788664435.094752:0:17144:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcd11f61c1413ea18 00000004:00100000:2.0:1788664435.094767:0:17144:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788664435.094824:0:17144:0:(import.c:65:import_set_state_nolock()) ffff93c430606800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664435.094892:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875550140553472:12345-0@lo:38:llog_process_th.0 Request processed in 229us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664435.094900:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788664435.094944:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c30480e680 x1875550140553472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664435.096319:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788664435.096338:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788664435.096348:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788664435.096356:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788664435.096360:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c40392d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788664435.096369:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875550140553472:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788664435.101151:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1788664435.102120:0:17874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788664435.102166:0:17874:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788664435.102185:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303956600/0xcd11f61c1413e9fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea03 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.102198:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303956600/0xcd11f61c1413e9fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea03 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788664435.102930:0:17874:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788664435.102933:0:17874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788664435.102934:0:17874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664435.102936:0:17874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664435.102937:0:17874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664435.102939:0:17874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664435.102940:0:17874:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788664435.102942:0:17874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664435.102943:0:17874:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788664435.102947:0:17874:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788664435.102950:0:17874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788664435.102951:0:17874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788664435.102952:0:17874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664435.102953:0:17874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664435.103607:0:17874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664435.103609:0:17874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664435.103610:0:17874:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788664435.103612:0:17874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664435.103613:0:17874:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788664435.103641:0:17874:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788664435.103664:0:17874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140553600:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788664435.103746:0:17874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664435.103805:0:17874:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664435.104079:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140553600 00000100:00100000:3.0:1788664435.104087:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140553600 00000100:00100000:3.0:1788664435.104136:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788664435.104145:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17874:x1875550140553600:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788664435.104171:0:17137:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788664435.104184:0:17137:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788664435.111271:0:17123:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788664435.111306:0:17137:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788664435.111320:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788664435.111695:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17874:x1875550140553600:12345-0@lo:253:mount.lustre.0 Request processed in 7546us (7944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664435.111719:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 20000000:01000000:2.0:1788664435.112640:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788664435.112647:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788664435.112668:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.112684:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c303957800/0xcd11f61c1413e923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e91c expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.112698:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c303b85600/0xcd11f61c1413e9e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e9e0 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.112716:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea1f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.112754:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c303b85600/0xcd11f61c1413e9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413e9e0 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.112783:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c303b85600/0xcd11f61c1413e9e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413e9e0 expref: 17 pid: 17137 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664435.112797:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875550140553728:0@lo:104: 00000100:00100000:2.0:1788664435.112843:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664435.112891:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c303957800/0xcd11f61c1413e923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413e91c expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.112899:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c303957800/0xcd11f61c1413e923 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413e91c expref: 17 pid: 17138 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664435.112907:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875550140553856:0@lo:104: 00000100:00100000:2.0:1788664435.112927:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664435.112943:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42da4e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664435.114395:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140553728 00000100:00100000:2.0:1788664435.114407:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140553728 00000100:00100000:2.0:1788664435.114441:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140553856 00000100:00100000:2.0:1788664435.114444:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140553856 00000100:00100000:2.0:1788664435.114459:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664435.114466:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+4:17159:x1875550140553728:12345-0@lo:104: 00010000:00010000:2.0:1788664435.114488:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413e9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413e9e7 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.116155:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664435.116168:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+4:17159:x1875550140553728:12345-0@lo:104: Request processed in 1699us (3321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664435.116178:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664435.116207:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664435.116217:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+3:17159:x1875550140553856:12345-0@lo:104: 00010000:00010000:2.0:1788664435.117392:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c40502a400/0xcd11f61c1413e91c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413e923 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.117480:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788664435.117488:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+3:17159:x1875550140553856:12345-0@lo:104: Request processed in 1273us (4558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664435.117497:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664435.117571:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875550140553728:0@lo:104: 00000100:00100000:2.0:1788664435.117583:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875550140553856:0@lo:104: 00010000:00010000:2.0:1788664435.117607:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.117627:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788664435.117632:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413e9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413e9e7 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.117640:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664435.117644:0:17132:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413e9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413e9e7 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.117660:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413e9e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413e9e7 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664435.117668:0:17132:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413e9e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413e9e7 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664435.117674:0:17132:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664435.117716:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413e9e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413e9e7 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.117723:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664435.117742:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413e9e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413e9e7 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.117750:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413e9e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413e9e7 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.117761:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664435.117765:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c40502a400/0xcd11f61c1413e91c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413e923 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.117788:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1788664435.117790:0:17132:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c40502a400/0xcd11f61c1413e91c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413e923 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.117796:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c40502a400/0xcd11f61c1413e91c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413e923 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664435.117802:0:17132:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c40502a400/0xcd11f61c1413e91c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413e923 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664435.117813:0:17132:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664435.117828:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c40502a400/0xcd11f61c1413e91c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413e923 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.117834:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664435.117840:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c40502a400/0xcd11f61c1413e91c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413e923 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.117847:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c40502a400/0xcd11f61c1413e91c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413e923 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.117861:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664435.117863:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664435.117864:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664435.117871:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664435.117890:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140553984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664435.117927:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664435.117964:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664435.117970:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140554112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664435.117990:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664435.118023:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140553984 00000100:00100000:2.0:1788664435.118029:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140553984 00010000:00010000:2.0:1788664435.118051:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c303b85600/0xcd11f61c1413e9e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413e9e0 expref: 18 pid: 17137 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664435.118072:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140554112 00000100:00100000:2.0:1788664435.118075:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140554112 00010000:00010000:2.0:1788664435.118085:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c303957800/0xcd11f61c1413e923 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413e91c expref: 19 pid: 17138 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664435.118112:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664435.118119:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+19:3636:x1875550140553984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664435.118143:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664435.118150:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c303b85600/0xcd11f61c1413e9e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413e9e0 expref: 19 pid: 17137 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118160:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c303b85600/0xcd11f61c1413e9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413e9e0 expref: 19 pid: 17137 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118173:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303b85600/0xcd11f61c1413e9e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413e9e0 expref: 19 pid: 17137 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118184:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664435.118212:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:3636:x1875550140553984:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664435.118219:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664435.118248:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664435.118254:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:3636:x1875550140554112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664435.118261:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664435.118265:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c303957800/0xcd11f61c1413e923 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413e91c expref: 17 pid: 17138 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118274:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c303957800/0xcd11f61c1413e923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413e91c expref: 17 pid: 17138 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118284:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303957800/0xcd11f61c1413e923 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413e91c expref: 17 pid: 17138 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118306:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea1f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118314:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea1f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788664435.118327:0:17128:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007147744s 00010000:00010000:2.0:1788664435.118332:0:17128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118339:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118346:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea1f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118352:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118358:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:2.0:1788664435.118362:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118369:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea1f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118381:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea1f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118389:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664435.118416:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+16:3636:x1875550140554112:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664435.118422:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788664435.118443:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118450:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664435.118456:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea1f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664435.118481:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140554112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664435.118489:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140553984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664435.118520:0:17874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17874:1875550140553600:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788664435.118529:0:17874:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788664435.118532:0:17874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788664435.118534:0:17874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788664435.118535:0:17874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664435.118536:0:17874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664435.118537:0:17874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664435.118538:0:17874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664435.118540:0:17874:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788664435.118541:0:17874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664435.118542:0:17874:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788664435.118550:0:17874:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:2.0:1788664435.143525:0:17874:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1788664435.144066:0:17901:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788664435.144082:0:17874:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:1.0:1788664435.144223:0:17900:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788664435.144227:0:17900:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:2.0:1788664435.144476:0:17901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788664435.144862:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17902:1875550140554240:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788664435.145239:0:17874:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788664435.145267:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788664435.145714:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664435.145746:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412077e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788664435.146071:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140554240 00000100:00100000:3.0:1788664435.146079:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140554240 00000100:00100000:3.0:1788664435.146125:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788664435.146134:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17902:x1875550140554240:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788664435.146211:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17902:x1875550140554240:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 78us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664435.146217:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788664435.146252:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17902:1875550140554240:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788664435.146279:0:17902:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000004:00000080:0.0:1788664435.146297:0:17874:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:3.0:1788664435.146310:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ff100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17902:1875550140554368:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788664435.146339:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664435.146355:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406b8e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664435.146360:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140554368 00000100:00100000:0.0:1788664435.146364:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140554368 00000100:00100000:0.0:1788664435.146393:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788664435.146399:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17902:x1875550140554368:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788664435.146484:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17902:x1875550140554368:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 85us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664435.146491:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788664435.146798:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ff100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17902:1875550140554368:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788664435.146853:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ff100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17902:1875550140554496:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788664435.146881:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664435.146906:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406b8e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788664435.146939:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140554496 00000100:00100000:0.0:1788664435.146944:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140554496 00000100:00100000:0.0:1788664435.146969:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664435.146975:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17902:x1875550140554496:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788664435.147024:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17902:x1875550140554496:12345-0@lo:900:lod0001_rec0000.0 Request processed in 49us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664435.147031:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788664435.147046:0:17902:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c4350ff100 x1875550140554496/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788664451 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664435.147057:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ff100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17902:1875550140554496:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788664435.147095:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ff100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17902:1875550140554624:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788664435.147121:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664435.147143:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406b8e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664435.147179:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140554624 00000100:00100000:1.0:1788664435.147195:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140554624 00000040:00080000:2.0:1788664435.148536:0:17901:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000100:00100000:1.0:1788664435.148652:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788664435.148670:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17902:x1875550140554624:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788664435.148793:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17902:x1875550140554624:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 131us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664435.148800:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000004:00080000:2.0:1788664435.148908:0:17901:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788664435.149291:0:17874:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788664435.149377:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664435.151244:0:17874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1788664435.151249:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ff100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17902:1875550140554624:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788664435.151306:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664435.151900:0:17874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788664435.151932:0:17874:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788664435.152253:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788664435.152917:0:17874:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:1.0:1788664435.154352:0:17874:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:0.0:1788664435.156835:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788664435.156975:0:17902:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788664435.156980:0:17902:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1788664435.164855:0:17874:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788664435.164893:0:17874:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaa6d41c63988 00100000:10000000:1.0:1788664435.164901:0:17874:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788664435.168820:0:17874:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788664435.168862:0:17874:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788664435.168887:0:17874:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788664435.168906:0:17874:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788664435.172227:0:17874:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788664435.173104:0:17874:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788664435.390913:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664435.903812:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00000040:00080000:1.0:1788664436.162012:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788664436.414217:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788664436.545181:0:17140:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788664436.545189:0:17140:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c42f768000 from 8 10000000:01000000:2.0:1788664436.545193:0:17140:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788664436.545246:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e3800/0xcd11f61c1413ea26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664436.545258:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4029e3800/0xcd11f61c1413ea26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664436.545282:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4029e3800/0xcd11f61c1413ea26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664436.545308:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140554752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788664436.545373:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664436.545419:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4224f3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788664436.545537:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140554752 00000100:00100000:1.0:1788664436.545544:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140554752 00000100:00100000:1.0:1788664436.545601:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788664436.545610:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+16:17140:x1875550140554752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664436.545623:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664436.545637:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303b85400/0xcd11f61c1413ea2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413ea26 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664436.545661:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303b85400/0xcd11f61c1413ea2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413ea26 expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664436.545684:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303b85400/0xcd11f61c1413ea2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413ea26 expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664436.545692:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85400, rc 0) 00000100:00100000:1.0:1788664436.545743:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17140:x1875550140554752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664436.545750:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788664436.545887:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140554752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664436.545902:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4029e3800/0xcd11f61c1413ea26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea2d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664436.545911:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4029e3800/0xcd11f61c1413ea26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413ea2d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664436.545970:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140554880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788664436.546010:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664436.546035:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4224f3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788664436.546126:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140554880 00000100:00100000:1.0:1788664436.546131:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140554880 00000100:00100000:1.0:1788664436.546165:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788664436.546172:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17140:x1875550140554880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788664436.546185:0:17137:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788664436.546200:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788664436.546203:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788664436.546286:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17140:x1875550140554880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664436.546293:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788664436.546407:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140554880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788664436.546446:0:17140:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788664436.546453:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e3800/0xcd11f61c1413ea26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea2d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664436.546461:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e3800/0xcd11f61c1413ea26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea2d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664436.546471:0:17140:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788664436.546473:0:17140:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c43f740000 from 8 10000000:01000000:2.0:1788664436.546476:0:17140:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788664436.546492:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413ea34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664436.546499:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413ea34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664436.546506:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413ea34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664436.546518:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140555008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788664436.546544:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664436.546567:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4087a5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788664436.546673:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140555008 00000100:00100000:1.0:1788664436.546678:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140555008 00000100:00100000:1.0:1788664436.546713:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788664436.546719:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17140:x1875550140555008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664436.546727:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664436.546735:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303b84a00/0xcd11f61c1413ea3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413ea34 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664436.546747:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303b84a00/0xcd11f61c1413ea3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413ea34 expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664436.546766:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303b84a00/0xcd11f61c1413ea3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413ea34 expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664436.546795:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b84a00, rc 0) 00000100:00100000:1.0:1788664436.546823:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17140:x1875550140555008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664436.546829:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788664436.548464:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140555008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664436.548487:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413ea34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea3b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664436.548509:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413ea34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413ea3b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664436.550687:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140555136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788664436.550790:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664436.550837:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4087a5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664436.551912:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140555136 00000100:00100000:0.0:1788664436.551924:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140555136 00000100:00100000:0.0:1788664436.551998:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788664436.552008:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17140:x1875550140555136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788664436.552038:0:17136:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788664436.552055:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788664436.552058:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788664436.552177:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17140:x1875550140555136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 170us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664436.552186:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788664436.552392:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140555136:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788664436.552442:0:17140:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788664436.552456:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413ea34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea3b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664436.552466:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413ea34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea3b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664436.927053:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00000040:00080000:2.0:1788664437.185839:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788664437.439116:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664437.951907:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00010000:00010000:1.0:1788664438.465539:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664438.974554:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00010000:00010000:0.0:1788664439.486696:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664440.000339:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 0 seconds 00000001:02000400:0.0:1788664440.057370:0:18145:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1788664440.382109:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788664440.382116:0:16550:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788664440.382119:0:16550:0:(import.c:65:import_set_state_nolock()) ffff93c403830800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788664440.382130:0:16550:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93c403830800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788664440.382153:0:16550:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3035a7100 x1875550140555520/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788664440.382178:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788664440.382182:0:16550:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788664440.382185:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788664440.382188:0:16550:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788664440.382215:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788664440.382231:0:16550:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788664440.382233:0:16550:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788664440.382236:0:16550:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788664440.382270:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3639:1875550140555392:0@lo:400:kworker.0 00000100:00100000:0.0:1788664440.382339:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664440.382389:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788664440.382395:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140555264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788664440.382422:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664440.382441:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140555904:0@lo:400:kworker.0 00000100:00100000:0.0:1788664440.382469:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664440.382495:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140555648:0@lo:400:kworker.0 00000100:00100000:0.0:1788664440.382517:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664440.382535:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664440.382541:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140555776:0@lo:400:kworker.0 00000100:00100000:0.0:1788664440.382562:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664440.382594:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140555392 00000100:00100000:0.0:1788664440.382601:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140555392 00000100:00100000:0.0:1788664440.382641:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788664440.382649:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:3639:x1875550140555392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664440.382709:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:3639:x1875550140555392:12345-0@lo:400:kworker.0 Request processed in 61us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664440.382716:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788664440.382743:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140555264 00000100:00100000:0.0:1788664440.382747:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140555264 00000100:00100000:0.0:1788664440.382793:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140555776 00000100:00100000:0.0:1788664440.382805:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140555776 00000100:00100000:0.0:1788664440.382825:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788664440.382831:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3639:x1875550140555264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788664440.382862:0:17883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788664440.382894:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3639:x1875550140555264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664440.382900:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788664440.382911:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664440.382917:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140555776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664440.383138:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140555776:12345-0@lo:400:kworker.0 Request processed in 220us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664440.383145:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664440.383164:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140555904 00000100:00100000:0.0:1788664440.383168:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140555904 00000100:00100000:0.0:1788664440.383190:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140555648 00000100:00100000:0.0:1788664440.383192:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140555648 00000100:00100000:0.0:1788664440.383203:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664440.383209:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140555904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664440.383238:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140555904:12345-0@lo:400:kworker.0 Request processed in 29us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664440.383243:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664440.383255:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664440.383261:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140555648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664440.383287:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140555648:12345-0@lo:400:kworker.0 Request processed in 27us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664440.383292:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664440.383340:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140555776:0@lo:400:kworker.0 00010000:00080000:0.0:1788664440.383362:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c3035a4380 x1875550140555648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664440.383373:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140555648:0@lo:400:kworker.0 00000100:00100000:0.0:1788664440.383406:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140555264:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1788664440.383416:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c3035a6680 x1875550140555904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664440.383425:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140555904:0@lo:400:kworker.0 00000100:00100000:0.0:1788664440.383432:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3639:1875550140555392:0@lo:400:kworker.0 00000100:00100000:1.0:1788664440.383609:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140555520:0@lo:38:kworker.0 00000100:00100000:1.0:1788664440.383642:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664440.384965:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140555520 00000100:00100000:0.0:1788664440.384977:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140555520 00000100:00100000:0.0:1788664440.385019:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664440.385025:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3635:x1875550140555520:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788664440.385053:0:17883:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:0.0:1788664440.385275:0:17883:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd11f61c1413ea42 00000004:00100000:0.0:1788664440.385292:0:17883:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788664440.385298:0:17883:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788664440.395193:0:17883:0:(import.c:65:import_set_state_nolock()) ffff93c42b0d2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664440.395288:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1875550140555520:12345-0@lo:38:kworker.0 Request processed in 10260us (11643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664440.395299:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788664440.395421:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788664440.395431:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788664440.395437:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788664440.395440:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c403830800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788664440.395461:0:3635:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000010fbb1ea): req@ffff93c30480f100 x1875550140548096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664440.395482:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140555520:0@lo:38:kworker.0 00000100:00100000:0.0:1788664440.395564:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664440.395587:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412443180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664440.395601:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140548096 00000100:00100000:0.0:1788664440.395607:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140548096 00000100:00100000:0.0:1788664440.395643:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664440.395651:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17184:x1875550140548096:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788664440.395726:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17184:x1875550140548096:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 76us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664440.395733:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664440.395760:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17184:1875550140548096:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788664440.395808:0:17184:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788664440.395851:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17184:1875550140556032:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788664440.395880:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664440.395904:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788664440.395914:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140556032 00000100:00100000:0.0:1788664440.395917:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140556032 00000100:00100000:0.0:1788664440.395949:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788664440.395955:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17184:x1875550140556032:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788664440.396049:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17184:x1875550140556032:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 93us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664440.396055:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788664440.396079:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17184:1875550140556032:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788664440.396137:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17184:1875550140556160:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788664440.396159:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664440.396172:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788664440.396189:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140556160 00000100:00100000:0.0:1788664440.396192:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140556160 00000100:00100000:0.0:1788664440.396211:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788664440.396217:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17184:x1875550140556160:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788664440.396259:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17184:x1875550140556160:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 42us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664440.396265:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788664440.396287:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17184:1875550140556160:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788664440.396321:0:17184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788664440.397922:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664440.397941:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140556288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664440.397989:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664440.398874:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140556288 00000100:00100000:3.0:1788664440.398883:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140556288 00000100:00100000:3.0:1788664440.398940:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788664440.398949:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1875550140556288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664440.398982:0:17883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788664440.399041:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1875550140556288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664440.399047:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788664440.399090:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140556288:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788664440.400709:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788664440.401025:0:17184:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:0.0:1788664440.401030:0:17184:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788664440.515756:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788664441.034973:0:18197:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788664441.035361:0:18197:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788664441.534934:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788664441.916707:0:18247:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788664441.917167:0:18247:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788664441.983296:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788664442.558987:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788664442.928751:0:18296:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1729fe40 20000000:00000080:0.0:1788664442.928786:0:18296:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c406ff9800 uarg=0000000000000000 20000000:01000000:0.0:1788664442.928826:0:18296:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788664442.928833:0:18296:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788664442.928838:0:18296:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788664442.929894:0:18297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788664442.930639:0:18296:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788664442.937456:0:18296:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788664442.937638:0:18296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea49 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.937666:0:18296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c303956c00/0xcd11f61c1413e8f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e8eb expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.937674:0:18296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4029e2800/0xcd11f61c1413e9f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413e9ee expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.937682:0:18296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea49 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.937726:0:18296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4029e2800/0xcd11f61c1413e9f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413e9ee expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.937740:0:18296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c4029e2800/0xcd11f61c1413e9f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413e9ee expref: 17 pid: 17138 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664442.937798:0:18296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18296:1875550140556416:0@lo:104: 00000100:00100000:2.0:1788664442.937863:0:18296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664442.937932:0:18296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c303956c00/0xcd11f61c1413e8f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413e8eb expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.937939:0:18296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c303956c00/0xcd11f61c1413e8f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413e8eb expref: 17 pid: 17137 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664442.937947:0:18296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18296:1875550140556544:0@lo:104: 00000100:00100000:2.0:1788664442.937973:0:18296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664442.937995:0:18296:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788664442.938080:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140556416 00000100:00100000:0.0:1788664442.938088:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140556416 00000100:00100000:0.0:1788664442.938124:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140556544 00000100:00100000:0.0:1788664442.938127:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140556544 00000100:00100000:0.0:1788664442.938140:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664442.938148:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+4:18296:x1875550140556416:12345-0@lo:104: 00010000:00010000:0.0:1788664442.938169:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c303956e00/0xcd11f61c1413e9ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413e9f5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664442.938240:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788664442.938246:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+4:18296:x1875550140556416:12345-0@lo:104: Request processed in 99us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664442.938253:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664442.938270:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664442.938277:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+3:18296:x1875550140556544:12345-0@lo:104: 00010000:00010000:0.0:1788664442.938284:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413e8eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413e8f2 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664442.938312:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788664442.938317:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+3:18296:x1875550140556544:12345-0@lo:104: Request processed in 42us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664442.938323:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788664442.938338:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664442.938343:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c303956e00/0xcd11f61c1413e9ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413e9f5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664442.938350:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956e00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664442.938353:0:17132:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c303956e00/0xcd11f61c1413e9ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413e9f5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664442.938362:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c303956e00/0xcd11f61c1413e9ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413e9f5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664442.938369:0:17132:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c303956e00/0xcd11f61c1413e9ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413e9f5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664442.938375:0:17132:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664442.938413:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c303956e00/0xcd11f61c1413e9ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413e9f5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664442.938420:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664442.938439:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c303956e00/0xcd11f61c1413e9ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413e9f5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664442.938446:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c303956e00/0xcd11f61c1413e9ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413e9f5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664442.938458:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664442.938461:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413e8eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413e8f2 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664442.938466:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84200 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664442.938469:0:17132:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413e8eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413e8f2 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664442.938476:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413e8eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413e8f2 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664442.938482:0:17132:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413e8eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413e8f2 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664442.938488:0:17132:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664442.938499:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413e8eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413e8f2 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664442.938505:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664442.938511:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413e8eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413e8f2 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664442.938528:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413e8eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413e8f2 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664442.938541:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664442.938543:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664442.938544:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664442.938556:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140556672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664442.938586:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664442.938605:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664442.938610:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140556800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664442.938629:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664442.939067:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140556672 00000100:00100000:2.0:1788664442.939073:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140556672 00010000:00010000:2.0:1788664442.939094:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4029e2800/0xcd11f61c1413e9f5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413e9ee expref: 18 pid: 17138 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664442.939117:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140556800 00000100:00100000:2.0:1788664442.939120:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140556800 00010000:00010000:2.0:1788664442.939130:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c303956c00/0xcd11f61c1413e8f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413e8eb expref: 19 pid: 17137 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664442.939141:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664442.939147:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+19:3636:x1875550140556672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664442.939249:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664442.939256:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4029e2800/0xcd11f61c1413e9f5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413e9ee expref: 19 pid: 17138 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.939267:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4029e2800/0xcd11f61c1413e9f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413e9ee expref: 19 pid: 17138 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.939289:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664442.939326:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+19:3636:x1875550140556672:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664442.939333:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664442.939348:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788664442.939354:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:3636:x1875550140556800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664442.939362:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664442.939365:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c303956c00/0xcd11f61c1413e8f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413e8eb expref: 18 pid: 17137 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.939378:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c303956c00/0xcd11f61c1413e8f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413e8eb expref: 18 pid: 17137 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.939389:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea49 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.939397:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea49 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.939411:0:17129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea49 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.939418:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea49 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.939425:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea49 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.939431:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea49 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.939443:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:2.0:1788664442.939447:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea49 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.939455:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea49 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.939464:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea49 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664442.939547:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664442.939572:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:3636:x1875550140556800:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664442.939579:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788664442.939614:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140556800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664442.939623:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140556672:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788664442.939639:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664442.939681:0:18296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e2800/0xcd11f61c1413e9f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413e9ee expref: 17 pid: 17138 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664442.939695:0:18296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18296:1875550140556416:0@lo:104: 00010000:00010000:1.0:1788664442.939706:0:18296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303956c00/0xcd11f61c1413e8f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413e8eb expref: 16 pid: 17137 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664442.939714:0:18296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18296:1875550140556544:0@lo:104: 00010000:00010000:1.0:1788664442.939730:0:18296:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea49 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664442.939739:0:18296:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea49 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664442.939745:0:18296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea49 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664442.939758:0:18296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ea49 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664443.588853:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664444.608550:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788664444.989837:0:17140:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:3.0:1788664444.989844:0:17140:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c42f768000 from 13 10000000:01000000:3.0:1788664444.989848:0:17140:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788664444.989890:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40502ac00/0xcd11f61c1413ea50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664444.989908:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c40502ac00/0xcd11f61c1413ea50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664444.989920:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c40502ac00/0xcd11f61c1413ea50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664444.989944:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140556928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664444.990011:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664444.990058:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c30397ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664444.990162:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140556928 00000100:00100000:1.0:1788664444.990172:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140556928 00000100:00100000:1.0:1788664444.990234:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788664444.990244:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+16:17140:x1875550140556928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664444.990258:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664444.990281:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413ea57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413ea50 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664444.990304:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413ea57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413ea50 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664444.990316:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413ea57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413ea50 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664444.990325:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85a00, rc 0) 00000100:00100000:1.0:1788664444.990378:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17140:x1875550140556928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664444.990386:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788664444.991126:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140556928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664444.991155:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c40502ac00/0xcd11f61c1413ea50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea57 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664444.991167:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c40502ac00/0xcd11f61c1413ea50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413ea57 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664444.991233:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140557056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664444.991275:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664444.991304:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664444.991321:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140557056 00000100:00100000:0.0:1788664444.991325:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140557056 00000100:00100000:0.0:1788664444.991355:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788664444.991370:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17140:x1875550140557056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664444.991494:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17140:x1875550140557056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664444.991501:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788664444.991517:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140557056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664444.991545:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140557184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664444.991583:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664444.991687:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086300 going to sleep for 11 seconds 00000100:00100000:0.0:1788664444.992308:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140557184 00000100:00100000:0.0:1788664444.992314:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140557184 00000100:00100000:0.0:1788664444.992346:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788664444.992354:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17140:x1875550140557184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664444.992538:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17140:x1875550140557184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664444.992546:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788664444.992592:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140557184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788664444.995632:0:18397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788664444.997431:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788664444.997467:0:17140:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788664444.997478:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40502ac00/0xcd11f61c1413ea50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea57 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664444.997491:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c40502ac00/0xcd11f61c1413ea50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea57 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664444.997513:0:17140:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788664444.997516:0:17140:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c43f740000 from 13 10000000:01000000:1.0:1788664444.997518:0:17140:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664444.997651:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413ea5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664444.997660:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413ea5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664444.997672:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413ea5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664444.997695:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140557312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788664444.997888:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664444.998385:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303711240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664444.998650:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140557312 00000100:00100000:2.0:1788664444.998657:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140557312 00000100:00100000:2.0:1788664444.998829:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788664444.998848:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+17:17140:x1875550140557312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664444.998863:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664444.998877:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413ea65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413ea5e expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664444.998912:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413ea65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413ea5e expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664444.998924:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413ea65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413ea5e expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664444.998933:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e3200, rc 0) 00000100:00100000:2.0:1788664444.998982:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17140:x1875550140557312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664444.998989:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788664444.999261:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140557312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664444.999278:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413ea5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea65 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664444.999288:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413ea5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413ea65 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664444.999355:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140557440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664444.999385:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664444.999441:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086240 going to sleep for 11 seconds 00000100:00100000:1.0:1788664444.999473:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140557440 00000100:00100000:1.0:1788664444.999477:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140557440 00000100:00100000:1.0:1788664444.999653:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788664444.999662:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3038bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17140:x1875550140557440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664444.999854:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3038bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17140:x1875550140557440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664444.999862:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788664444.999949:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140557440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664444.999978:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140557568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664445.000021:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664445.000041:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664445.000054:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140557568 00000100:00100000:2.0:1788664445.000057:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140557568 00000100:00100000:2.0:1788664445.000081:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788664445.000255:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3038b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17140:x1875550140557568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664445.000327:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3038b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:17140:x1875550140557568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664445.000335:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788664445.000371:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140557568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788664445.001334:0:18398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788664445.001383:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788664445.001400:0:17140:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788664445.001410:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413ea5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea65 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664445.001420:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413ea5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea65 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664445.501958:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664445.501979:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140557696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664445.502041:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664445.502088:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140557696 00000100:00100000:3.0:1788664445.502097:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140557696 00000100:00100000:3.0:1788664445.502140:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788664445.502148:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1875550140557696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788664445.502461:0:17883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788664445.502519:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1875550140557696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 371us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664445.502527:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788664445.502623:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140557696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664445.504816:0:3635:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664435/real 1788664435] req@ffff93c3039c9f80 x1875550140551680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664445 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664445.504842:0:3635:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c3039c9f80 x1875550140551680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664445 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664445.504853:0:3635:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664435/real 1788664435] req@ffff93c30480ed80 x1875550140551424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664445 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664445.504865:0:3635:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c30480ed80 x1875550140551424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664445 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664445.504874:0:3635:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664430/real 1788664430] req@ffff93c3039c8700 x1875550140549504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664445 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664445.505069:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664445.505084:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140557824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664445.505142:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664445.505206:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140557824 00000100:00100000:1.0:1788664445.505212:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140557824 00000100:00100000:1.0:1788664445.505249:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788664445.505258:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140557824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664445.505291:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788664445.505524:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140557824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 267us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664445.505531:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788664445.505570:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140557824:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788664445.505681:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788664445.505687:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788664445.505689:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788664445.505692:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788664445.505732:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788664445.505742:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788664445.505744:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788664445.505747:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788664445.505793:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140558080:0@lo:400:kworker.0 00000100:00100000:3.0:1788664445.505825:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664445.505849:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788664445.505855:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140557952:0@lo:400:kworker.0 00000100:00100000:3.0:1788664445.505875:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664445.505918:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140558080 00000100:00100000:3.0:1788664445.505923:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140558080 00000100:00100000:3.0:1788664445.505949:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140557952 00000100:00100000:3.0:1788664445.505952:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140557952 00000100:00100000:3.0:1788664445.505966:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664445.505972:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140558080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664445.506009:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140558080:12345-0@lo:400:kworker.0 Request processed in 37us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664445.506015:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664445.506027:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664445.506033:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140557952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664445.506059:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140557952:12345-0@lo:400:kworker.0 Request processed in 26us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664445.506064:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788664445.506090:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c4350fd880 x1875550140557952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664445.506100:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140557952:0@lo:400:kworker.0 00010000:00080000:3.0:1788664445.506119:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c4350ffb80 x1875550140558080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664445.506127:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140558080:0@lo:400:kworker.0 00000100:00100000:0.0:1788664445.506466:0:3635:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c3039c8700 x1875550140549504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664445 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664445.506478:0:3635:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664430/real 1788664430] req@ffff93c3039cb480 x1875550140549632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664445 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664445.506501:0:3635:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c3039cb480 x1875550140549632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664445 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788664445.506513:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c30256e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788664445.506532:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788664445.506536:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140551680:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788664445.506542:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c3041b1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788664445.506547:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788664445.506550:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140551424:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788664445.506554:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c40641c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788664445.506557:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788664445.506560:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140549504:0@lo:8:kworker.0 00000100:00080000:0.0:1788664445.506563:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c408214800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788664445.506566:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788664445.506568:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140549632:0@lo:8:kworker.0 00000100:00080000:3.0:1788664445.508015:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788664445.508024:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788664445.508027:0:36:0:(import.c:65:import_set_state_nolock()) ffff93c40641c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788664445.508033:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 525 00000100:00080000:3.0:1788664445.508039:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788664445.508046:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93c40641c800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788664445.508076:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c4350ffb80 x1875550140558208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788664445.508094:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788664445.508097:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788664445.508099:0:36:0:(import.c:65:import_set_state_nolock()) ffff93c408214800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788664445.508101:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 525 00000100:00080000:3.0:1788664445.508104:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788664445.508107:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c408214800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788664445.508118:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c4350fd880 x1875550140558336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788664445.508126:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788664445.508129:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788664445.508130:0:36:0:(import.c:65:import_set_state_nolock()) ffff93c3041b1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788664445.508132:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 530 00000100:00080000:3.0:1788664445.508135:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788664445.508150:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93c3041b1000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788664445.508161:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c4350fe300 x1875550140558464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788664445.508168:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788664445.508171:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788664445.508173:0:36:0:(import.c:65:import_set_state_nolock()) ffff93c30256e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788664445.508176:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 530 00000100:00080000:3.0:1788664445.508200:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788664445.508206:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93c30256e800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788664445.508222:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c4350fea00 x1875550140558592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788664445.508681:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140558208:0@lo:8:kworker.0 00000400:00000100:0.0:1788664445.508742:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875550140558208 offset 0 length 520: 4 00000100:00100000:0.0:1788664445.508793:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140558336:0@lo:8:kworker.0 00000400:00000100:0.0:1788664445.508813:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875550140558336 offset 0 length 520: 4 00000100:00100000:0.0:1788664445.508825:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140558464:0@lo:8:kworker.0 00000400:00000100:0.0:1788664445.508842:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875550140558464 offset 0 length 520: 4 00000100:00100000:0.0:1788664445.508852:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140558592:0@lo:8:kworker.0 00000400:00000100:0.0:1788664445.508876:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875550140558592 offset 0 length 520: 4 00010000:00010000:0.0:1788664445.631228:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788664446.025717:0:17875:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788664446.655725:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788664447.422513:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788664447.679677:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664448.704098:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788664449.407022:0:18644:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:0.0:1788664449.407026:0:18644:0:(obd_mount.c:924:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788664449.407028:0:18644:0:(obd_mount.c:927:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788664449.407143:0:18644:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c3041b2800 00000020:01000004:0.0:1788664449.407157:0:18644:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788664449.407170:0:18644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788664449.407183:0:18644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93c4306a8000) 00000020:00000080:0.0:1788664449.407198:0:18644:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788664449.509467:0:18644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788664449.510242:0:18644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788664449.510828:0:18644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788664449.511096:0:18644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788664449.511367:0:18644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788664449.511681:0:18644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788664449.511919:0:18644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788664449.517553:0:18644:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788664449.518084:0:18644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788664449.518096:0:18644:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788664449.518108:0:18644:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd11f61c1413ea73 00000020:01000004:3.0:1788664449.518115:0:18644:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788664449.518134:0:18644:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788664449.518137:0:18644:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788664449.518142:0:18644:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788664449.518147:0:18644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788664449.518157:0:18644:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93c435374d40) 00000020:00000080:3.0:1788664449.518169:0:18644:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788664449.519927:0:18644:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788664449.520103:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788664449.520122:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788664449.524372:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788664449.524390:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788664449.535394:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788664449.535412:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788664449.542594:0:18644:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788664449.545340:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788664449.545356:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788664449.548979:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788664449.548997:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788664449.598729:0:18644:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664449.599307:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788664449.599314:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788664449.602960:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788664449.602973:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788664449.603843:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788664449.603853:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788664449.605539:0:18644:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664449.605729:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788664449.605736:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788664449.607676:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788664449.607686:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788664449.665288:0:18644:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788664449.665475:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788664449.665482:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788664449.674664:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788664449.674678:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788664449.675868:0:18644:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788664449.676063:0:18644:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788664449.676070:0:18644:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788664449.698247:0:18644:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788664449.698298:0:18644:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788664449.698303:0:18644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788664449.698304:0:18644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788664449.698306:0:18644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664449.698307:0:18644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664449.698308:0:18644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664449.698309:0:18644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664449.698310:0:18644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664449.698312:0:18644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664449.698314:0:18644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788664449.698317:0:18644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788664449.698319:0:18644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788664449.698321:0:18644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788664449.698322:0:18644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664449.698323:0:18644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664449.698324:0:18644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664449.698325:0:18644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664449.698331:0:18644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664449.698333:0:18644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664449.698333:0:18644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788664449.698362:0:18644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788664449.698382:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140558720:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788664449.698468:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664449.698524:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086840 going to sleep for 11 seconds 00000100:00100000:3.0:1788664449.698601:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140558720 00000100:00100000:3.0:1788664449.698618:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140558720 00000100:00100000:3.0:1788664449.698672:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788664449.698682:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3038b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:18644:x1875550140558720:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788664449.698719:0:17137:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788664449.698723:0:17137:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788664449.698727:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788664449.699154:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3038b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:18644:x1875550140558720:12345-0@lo:253:mount.lustre.0 Request processed in 472us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664449.699162:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788664449.699259:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140558720:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788664449.699269:0:18644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788664449.699271:0:18644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788664449.699272:0:18644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788664449.699273:0:18644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664449.699274:0:18644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664449.699275:0:18644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664449.699276:0:18644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664449.699277:0:18644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664449.699279:0:18644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664449.699280:0:18644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788664449.699297:0:18644:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c3041b2800 from lustre-OST0000 10000000:01000000:1.0:1788664449.699325:0:18644:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788664449.699327:0:18644:0:(mgc_request.c:327:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788664449.699334:0:18644:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93c412cacd40 local copy 00010000:00010000:1.0:1788664449.699343:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e835 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664449.699423:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140558848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664449.699453:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664449.699472:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086540 going to sleep for 11 seconds 00000100:00100000:0.0:1788664449.699526:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140558848 00000100:00100000:0.0:1788664449.699531:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140558848 00000100:00100000:0.0:1788664449.699567:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788664449.699574:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:18644:x1875550140558848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664449.699655:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:18644:x1875550140558848:12345-0@lo:501:mount.lustre.0 Request processed in 82us (202us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788664449.699663:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788664449.699736:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140558848:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788664449.699749:0:18644:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788664449.699766:0:18644:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788664449.699793:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e835 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.699802:0:18644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e835 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664449.699843:0:18644:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c3041b2800 10000000:01000000:3.0:1788664449.699849:0:18644:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788664449.699853:0:18644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788664449.699856:0:18644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788664449.699871:0:18644:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788664449.699874:0:18644:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788664449.699893:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40502b800/0xcd11f61c1413ea81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.699902:0:18644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c40502b800/0xcd11f61c1413ea81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.699920:0:18644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c40502b800/0xcd11f61c1413ea81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664449.699934:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140558976:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788664449.699962:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664449.699985:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42da4ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788664449.700098:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140558976 00000100:00100000:0.0:1788664449.700108:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140558976 00000100:00100000:0.0:1788664449.700139:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788664449.700146:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+18:18644:x1875550140558976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664449.700155:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664449.700166:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303957600/0xcd11f61c1413ea88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413ea81 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664449.700186:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303957600/0xcd11f61c1413ea88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413ea81 expref: 19 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664449.700195:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303957600/0xcd11f61c1413ea88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413ea81 expref: 19 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664449.700203:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957600, rc 0) 00000100:00100000:0.0:1788664449.700230:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+19:18644:x1875550140558976:12345-0@lo:101:mount.lustre.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664449.700236:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788664449.700433:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140558976:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788664449.700445:0:18644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c40502b800/0xcd11f61c1413ea81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea88 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.700455:0:18644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c40502b800/0xcd11f61c1413ea81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413ea88 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788664449.702528:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788664449.703265:0:18644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788664449.707468:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788664449.707540:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788664449.707558:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788664449.707575:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788664449.707602:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788664449.707628:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788664449.707651:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788664449.707656:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788664449.707755:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140559104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788664449.707870:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664449.707917:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42da4e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788664449.710507:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140559104 00000100:00100000:0.0:1788664449.710523:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140559104 00000100:00100000:0.0:1788664449.710593:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788664449.710602:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+19:18644:x1875550140559104:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664449.710856:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+19:18644:x1875550140559104:12345-0@lo:501:mount.lustre.0 Request processed in 254us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664449.710864:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788664449.711655:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140559104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788664449.711715:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140559232:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788664449.711764:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664449.711932:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42da4e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788664449.714016:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140559232 00000100:00100000:0.0:1788664449.714031:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140559232 00000100:00100000:0.0:1788664449.714150:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788664449.714161:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+19:18644:x1875550140559232:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788664449.717422:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+19:18644:x1875550140559232:12345-0@lo:503:mount.lustre.0 Request processed in 3255us (5650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664449.717436:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788664449.717552:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140559232:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788664449.718075:0:18644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788664449.718152:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140559360:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664449.718204:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664449.720675:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664449.723041:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140559360 00000100:00100000:3.0:1788664449.723057:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140559360 00000100:00100000:3.0:1788664449.723114:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788664449.723123:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+19:18644:x1875550140559360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788664449.723853:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+19:18644:x1875550140559360:12345-0@lo:502:mount.lustre.0 Request processed in 728us (5646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664449.723927:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788664449.724127:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140559360:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788664449.724382:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788664449.724428:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788664449.724444:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788664449.724458:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788664449.724469:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788664449.724482:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788664449.724495:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788664449.724506:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788664449.724517:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788664449.724527:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788664449.724537:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788664449.724547:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788664449.724592:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140559488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664449.724650:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664449.724689:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664449.725006:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140559488 00000100:00100000:3.0:1788664449.725012:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140559488 00000100:00100000:3.0:1788664449.725049:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788664449.725057:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+19:18644:x1875550140559488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788664449.725152:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+19:18644:x1875550140559488:12345-0@lo:502:mount.lustre.0 Request processed in 94us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664449.725160:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788664449.725277:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140559488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788664449.725321:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788664449.725329:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788664449.726040:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788664449.726049:0:18661:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788664449.726055:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664449.726058:0:18661:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788664449.726064:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788664449.726078:0:18661:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93c406eb8000) 00000020:00000080:1.0:1788664449.726100:0:18661:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788664449.726105:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788664449.726189:0:18661:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c3041b2800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788664449.726198:0:18661:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788664449.726204:0:18661:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd11f61c1413ea96 00010000:00010000:0.0:1788664449.731011:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664449.732122:0:18661:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788664449.732483:0:18661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788664449.734173:0:18661:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788664449.735366:0:18661:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788664449.735378:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664449.735385:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664449.735387:0:18661:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788664449.735390:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788664449.735393:0:18661:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788664449.735394:0:18661:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788664449.735395:0:18661:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788664449.735397:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788664449.735399:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664449.735401:0:18661:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788664449.735403:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664449.735406:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664449.735407:0:18661:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788664449.735410:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788664449.735412:0:18661:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788664449.735414:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664449.735416:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664449.735417:0:18661:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788664449.735420:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664449.735422:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664449.735424:0:18661:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788664449.735427:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788664449.735450:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664449.735454:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664449.735455:0:18661:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788664449.735458:0:18661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788664449.741961:0:18644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788664449.742007:0:18644:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788664449.742023:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c40502b800/0xcd11f61c1413ea81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea88 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664449.742035:0:18644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c40502b800/0xcd11f61c1413ea81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ea88 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664449.742117:0:18644:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c3041b2800 from 1 10000000:01000000:1.0:1788664449.742135:0:18644:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664449.742174:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413ea9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664449.742182:0:18644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413ea9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664449.742192:0:18644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413ea9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664449.742217:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140559616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788664449.742286:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664449.742332:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3037110c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664449.742500:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140559616 00000100:00100000:0.0:1788664449.742508:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140559616 00000100:00100000:0.0:1788664449.742561:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788664449.742570:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+19:18644:x1875550140559616:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664449.742583:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664449.742596:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303957000/0xcd11f61c1413eaa4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413ea9d expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664449.742629:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303957000/0xcd11f61c1413eaa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413ea9d expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664449.742639:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303957000/0xcd11f61c1413eaa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413ea9d expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664449.742649:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957000, rc 0) 00000100:00100000:0.0:1788664449.743350:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+20:18644:x1875550140559616:12345-0@lo:101:mount.lustre.0 Request processed in 778us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664449.743368:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788664449.749179:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140559616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788664449.749206:0:18644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413ea9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eaa4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664449.749219:0:18644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413ea9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413eaa4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788664449.751309:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788664449.751574:0:18644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664449.752084:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788664449.752112:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788664449.752132:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788664449.752138:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788664449.752213:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140559744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664449.752276:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664449.752354:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303711540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664449.753694:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140559744 00000100:00100000:2.0:1788664449.753705:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140559744 00000100:00100000:2.0:1788664449.753828:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788664449.753838:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+20:18644:x1875550140559744:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664449.754146:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+20:18644:x1875550140559744:12345-0@lo:501:mount.lustre.0 Request processed in 308us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664449.754154:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788664449.754230:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140559744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664449.754288:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140559872:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788664449.754335:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664449.754491:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303711540 going to sleep for 11 seconds 00000100:00100000:3.0:1788664449.754576:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140559872 00000100:00100000:3.0:1788664449.754582:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140559872 00000100:00100000:3.0:1788664449.754617:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788664449.754625:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+20:18644:x1875550140559872:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788664449.754713:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+20:18644:x1875550140559872:12345-0@lo:503:mount.lustre.0 Request processed in 88us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664449.754720:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788664449.754846:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140559872:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788664449.755220:0:18644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788664449.755284:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664449.755325:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664449.755349:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3037110c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664449.755513:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140560000 00000100:00100000:3.0:1788664449.755518:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140560000 00000100:00100000:3.0:1788664449.755547:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788664449.755555:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+20:18644:x1875550140560000:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788664449.755740:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+20:18644:x1875550140560000:12345-0@lo:502:mount.lustre.0 Request processed in 185us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664449.755749:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788664449.755928:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560000:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788664449.756111:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788664449.756138:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788664449.756153:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788664449.756165:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788664449.756177:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788664449.756189:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788664449.756220:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788664449.756235:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788664449.756246:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788664449.756258:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788664449.756271:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788664449.756296:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560128:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664449.756337:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664449.756366:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3037110c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664449.756412:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140560128 00000100:00100000:3.0:1788664449.756417:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140560128 00000100:00100000:3.0:1788664449.756438:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788664449.756444:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+20:18644:x1875550140560128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788664449.756525:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+20:18644:x1875550140560128:12345-0@lo:502:mount.lustre.0 Request processed in 80us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664449.756532:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788664449.756684:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788664449.756719:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788664449.756727:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788664449.757572:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664449.757583:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664449.757585:0:18665:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788664449.757592:0:18665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c3041b2800 00000020:00000080:1.0:1788664449.757594:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788664449.757601:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664449.757604:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664449.757606:0:18665:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788664449.757618:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664449.757621:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664449.757622:0:18665:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788664449.757626:0:18665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c3041b2800 00000020:00000080:1.0:1788664449.757628:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788664449.757719:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664449.757723:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664449.757725:0:18665:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788664449.757727:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664449.757730:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664449.757731:0:18665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788664449.757734:0:18665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c3041b2800 00000020:00000080:1.0:1788664449.757736:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788664449.759754:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664449.759766:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664449.759768:0:18665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788664449.759822:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664449.759827:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664449.759828:0:18665:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788664449.759832:0:18665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c3041b2800 00000020:00000080:1.0:1788664449.759834:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788664449.765032:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664449.765042:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664449.765044:0:18665:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788664449.765049:0:18665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788664449.765222:0:18644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788664449.765249:0:18644:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788664449.765274:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413ea9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eaa4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664449.765287:0:18644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413ea9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eaa4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664449.765341:0:18644:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788664449.765344:0:18644:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff93c3041b2800 10000000:01000000:0.0:1788664449.765347:0:18644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c3041b2800 10000000:01000000:0.0:1788664449.765351:0:18644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788664449.765357:0:18644:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c3041b2800 from 1 10000000:01000000:0.0:1788664449.765360:0:18644:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788664449.765394:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303956c00/0xcd11f61c1413eaab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664449.765402:0:18644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303956c00/0xcd11f61c1413eaab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664449.765413:0:18644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303956c00/0xcd11f61c1413eaab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664449.765437:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788664449.765499:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664449.765536:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303406000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664449.775049:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140560256 00000100:00100000:3.0:1788664449.775066:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140560256 00000100:00100000:3.0:1788664449.775122:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788664449.775133:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+20:18644:x1875550140560256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788664449.775151:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664449.775169:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40502bc00/0xcd11f61c1413eab2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413eaab expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.775198:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40502bc00/0xcd11f61c1413eab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413eaab expref: 21 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.775210:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40502bc00/0xcd11f61c1413eab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413eaab expref: 21 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.775219:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502bc00, rc 0) 00000100:00100000:3.0:1788664449.775307:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:18644:x1875550140560256:12345-0@lo:101:mount.lustre.0 Request processed in 176us (9806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664449.775321:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788664449.775435:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560256:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664449.775455:0:18644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303956c00/0xcd11f61c1413eaab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eab2 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664449.775472:0:18644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303956c00/0xcd11f61c1413eaab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413eab2 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788664449.779323:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788664449.779604:0:18644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788664449.786569:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788664449.786636:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788664449.786653:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788664449.786667:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788664449.786680:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788664449.786693:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788664449.786705:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788664449.786720:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788664449.786733:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788664449.786746:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788664449.786759:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788664449.786787:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788664449.786801:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788664449.786831:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788664449.786843:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788664449.786855:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788664449.786866:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788664449.786877:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788664449.786888:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788664449.786899:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788664449.786910:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788664449.786921:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788664449.786932:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788664449.786943:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788664449.786955:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788664449.786968:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788664449.786991:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788664449.787005:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788664449.787016:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788664449.787044:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788664449.787062:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788664449.787075:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788664449.787089:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788664449.787101:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788664449.787114:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788664449.787128:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788664449.787143:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788664449.787169:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788664449.787175:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788664449.787275:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664449.787345:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664449.787806:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303406a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664449.787897:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140560384 00000100:00100000:1.0:1788664449.787910:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140560384 00000100:00100000:1.0:1788664449.787992:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788664449.788003:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:18644:x1875550140560384:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664449.788142:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:18644:x1875550140560384:12345-0@lo:501:mount.lustre.0 Request processed in 142us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664449.788150:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788664449.788214:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664449.788250:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560512:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788664449.788291:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664449.788314:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303406a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664449.788346:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140560512 00000100:00100000:1.0:1788664449.788350:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140560512 00000100:00100000:1.0:1788664449.788409:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788664449.788418:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:18644:x1875550140560512:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788664449.788582:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:18644:x1875550140560512:12345-0@lo:503:mount.lustre.0 Request processed in 166us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664449.788590:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788664449.788871:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560512:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788664449.789282:0:18644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788664449.789338:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664449.789372:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664449.789402:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303406000 going to sleep for 11 seconds 00000100:00100000:1.0:1788664449.789412:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140560640 00000100:00100000:1.0:1788664449.789416:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140560640 00000100:00100000:1.0:1788664449.789450:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788664449.789458:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:18644:x1875550140560640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664449.789541:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:18644:x1875550140560640:12345-0@lo:502:mount.lustre.0 Request processed in 83us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664449.789549:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788664449.789635:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560640:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788664449.789848:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788664449.789874:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788664449.789882:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788664449.789888:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788664449.789895:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788664449.789911:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788664449.789919:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788664449.789925:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788664449.789932:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788664449.789938:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788664449.789945:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788664449.789951:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788664449.789957:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788664449.789964:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788664449.789970:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788664449.789977:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788664449.789986:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788664449.789992:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788664449.789999:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788664449.790006:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788664449.790014:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788664449.790030:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788664449.790041:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788664449.790050:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788664449.790058:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788664449.790066:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788664449.790073:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788664449.790080:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788664449.790088:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788664449.790095:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788664449.790222:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788664449.790236:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788664449.790245:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788664449.790255:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788664449.790273:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788664449.790280:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788664449.790287:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788664449.790301:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788664449.790308:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788664449.790315:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788664449.790321:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788664449.790327:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788664449.790334:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788664449.790340:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788664449.790346:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788664449.790353:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788664449.790359:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788664449.790366:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788664449.790389:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664449.790428:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664449.790468:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140560768 00000100:00100000:1.0:1788664449.790473:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140560768 00000100:00100000:1.0:1788664449.790502:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788664449.790509:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:18644:x1875550140560768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664449.790572:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303406000 going to sleep for 11 seconds 00000100:00100000:1.0:1788664449.790599:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:18644:x1875550140560768:12345-0@lo:502:mount.lustre.0 Request processed in 90us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664449.790622:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664449.790628:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000040:00080000:0.0:1788664449.790885:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788664449.790908:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788664449.790928:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560896:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664449.790953:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664449.790978:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c303406000 going to sleep for 11 seconds 00000100:00100000:1.0:1788664449.790989:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140560896 00000100:00100000:1.0:1788664449.790993:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140560896 00000100:00100000:1.0:1788664449.791018:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788664449.791024:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:18644:x1875550140560896:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664449.791089:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:18644:x1875550140560896:12345-0@lo:502:mount.lustre.0 Request processed in 64us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664449.791096:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788664449.791239:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140560896:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788664449.791281:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788664449.791288:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788664449.792645:0:18670:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788664449.792659:0:18670:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93c4306a99c0) 00000020:00000080:0.0:1788664449.792691:0:18670:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788664449.792808:0:18670:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c3041b2800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788664449.792813:0:18670:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c3041b2800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788664449.792815:0:18670:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c3041b2800 3 00010000:00080000:0.0:1788664449.792842:0:18670:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c3039b5000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1788664449.794943:0:18670:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788664449.795144:0:18670:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788664449.795234:0:18670:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788664449.795243:0:18670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcd11f61c1413eac0 00000100:00080000:0.0:1788664449.795251:0:18670:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788664449.795256:0:18670:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93c3039b5000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788664449.795282:0:18670:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3035a4a80 x1875550140561024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788664449.795315:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1875550140561024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788664449.795367:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788664449.795408:0:18670:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788664449.795437:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788664449.795490:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788664449.795537:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788664449.795541:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788664449.795568:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788664449.795572:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788664449.795574:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788664449.795577:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788664449.795603:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140561152:0@lo:400:kworker.0 00000100:00100000:0.0:1788664449.795653:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664449.795675:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664449.795681:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140561280:0@lo:400:kworker.0 00000100:00100000:0.0:1788664449.795698:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664449.795720:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140561408:0@lo:400:kworker.0 00000100:00100000:0.0:1788664449.795734:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664449.795746:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664449.795749:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140561536:0@lo:400:kworker.0 00000100:00100000:0.0:1788664449.795761:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664449.795798:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140561152 00000100:00100000:0.0:1788664449.795803:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140561152 00000100:00100000:0.0:1788664449.795828:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140561408 00000100:00100000:0.0:1788664449.795830:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140561408 00000100:00100000:0.0:1788664449.795843:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788664449.795849:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140561152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664449.795886:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140561152:12345-0@lo:400:kworker.0 Request processed in 37us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664449.795891:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788664449.795899:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788664449.795903:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140561408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664449.795920:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140561408:12345-0@lo:400:kworker.0 Request processed in 17us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664449.795923:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788664449.795935:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140561024 00000100:00100000:0.0:1788664449.795937:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140561024 00000100:00100000:0.0:1788664449.795943:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140561280 00000100:00100000:0.0:1788664449.795944:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140561280 00000100:00100000:0.0:1788664449.795960:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140561536 00000100:00100000:0.0:1788664449.795962:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140561536 00000100:00100000:0.0:1788664449.795978:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788664449.795982:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140561280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664449.796003:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140561280:12345-0@lo:400:kworker.0 Request processed in 21us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664449.796006:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788664449.796013:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788664449.796016:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140561536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664449.796040:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140561536:12345-0@lo:400:kworker.0 Request processed in 23us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664449.796043:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788664449.796224:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664449.796227:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1875550140561024:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788664449.796244:0:17143:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:0.0:1788664449.796264:0:17143:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcd11f61c1413eac7 00000004:00100000:0.0:1788664449.796275:0:17143:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788664449.796296:0:17143:0:(import.c:65:import_set_state_nolock()) ffff93c3039b2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788664449.796322:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875550140561024:12345-0@lo:38:llog_process_th.0 Request processed in 94us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664449.796327:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788664449.796349:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c3035a5f80 x1875550140561536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664449.796359:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140561536:0@lo:400:kworker.0 00000100:00100000:0.0:1788664449.796366:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140561408:0@lo:400:kworker.0 00010000:00080000:0.0:1788664449.796394:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c3035a4a80 x1875550140561024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664449.796399:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788664449.796404:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788664449.796409:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788664449.796412:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788664449.796414:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c3039b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788664449.796418:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1875550140561024:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788664449.796431:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c3035a7480 x1875550140561280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664449.796437:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140561280:0@lo:400:kworker.0 00000100:00100000:0.0:1788664449.796683:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140561152:0@lo:400:kworker.0 00000020:01000004:1.0:1788664449.805664:0:18670:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788664449.805689:0:18670:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff93c406ebcd40) 00000020:00000080:1.0:1788664449.805715:0:18670:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788664449.805816:0:18670:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c3041b2800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788664449.805820:0:18670:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c3041b2800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788664449.805823:0:18670:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c3041b2800 3 00010000:00080000:1.0:1788664449.805858:0:18670:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c304361800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788664449.807582:0:18670:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1788664449.807748:0:18670:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788664449.807801:0:18670:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788664449.807812:0:18670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xcd11f61c1413ead5 00000100:00080000:1.0:1788664449.807823:0:18670:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788664449.807829:0:18670:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93c304361800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788664449.807861:0:18670:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c30480f800 x1875550140561664/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788664449.807891:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1875550140561664:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788664449.807946:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664449.808003:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140561664 00000100:00100000:1.0:1788664449.808017:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140561664 00000100:00100000:1.0:1788664449.808097:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788664449.808105:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1875550140561664:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788664449.808131:0:17143:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:1.0:1788664449.808162:0:17143:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xcd11f61c1413eadc 00000004:00100000:1.0:1788664449.808176:0:17143:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788664449.808209:0:17143:0:(import.c:65:import_set_state_nolock()) ffff93c304360800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664449.808261:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875550140561664:12345-0@lo:38:llog_process_th.0 Request processed in 155us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664449.808268:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788664449.808298:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c30480f800 x1875550140561664/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664449.808306:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664449.808311:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788664449.808315:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788664449.808318:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788664449.808319:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c304361800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788664449.808323:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1875550140561664:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788664449.810236:0:18670:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788664449.810269:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664449.810274:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664449.810277:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664449.810280:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664449.810283:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664449.810291:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664449.810294:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664449.810297:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788664449.816938:0:18670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788664449.816985:0:18644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788664449.817012:0:18644:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788664449.817030:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303956c00/0xcd11f61c1413eaab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eab2 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664449.817042:0:18644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303956c00/0xcd11f61c1413eaab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eab2 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788664449.817105:0:18644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788664449.817108:0:18644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788664449.817109:0:18644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664449.817110:0:18644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664449.817111:0:18644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664449.817112:0:18644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664449.817114:0:18644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664449.817116:0:18644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664449.817117:0:18644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788664449.817122:0:18644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788664449.817124:0:18644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788664449.817126:0:18644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788664449.817126:0:18644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664449.817127:0:18644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664449.817128:0:18644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664449.817130:0:18644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664449.817131:0:18644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664449.817132:0:18644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664449.817132:0:18644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788664449.817158:0:18644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788664449.817177:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140561792:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788664449.817265:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664449.817305:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c301086840 going to sleep for 11 seconds 00000100:00100000:3.0:1788664449.817520:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140561792 00000100:00100000:3.0:1788664449.817528:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140561792 00000100:00100000:3.0:1788664449.817572:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788664449.817583:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:18644:x1875550140561792:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788664449.817621:0:17137:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788664449.817634:0:17137:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788664449.824618:0:17137:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788664449.825595:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788664449.825918:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:18644:x1875550140561792:12345-0@lo:253:mount.lustre.0 Request processed in 8334us (8649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664449.825930:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788664449.825952:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:18644:1875550140561792:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788664449.825968:0:18644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788664449.825972:0:18644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788664449.825974:0:18644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788664449.825975:0:18644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664449.825976:0:18644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664449.825978:0:18644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664449.825980:0:18644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664449.825981:0:18644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788664449.825984:0:18644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664449.825985:0:18644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788664449.826001:0:18644:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788664449.831652:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788664449.831660:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788664449.831679:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eae3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.831696:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c303b85400/0xcd11f61c1413ea2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413ea26 expref: 20 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.831703:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c303b84a00/0xcd11f61c1413ea3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413ea34 expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.831710:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eae3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.831750:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c303b84a00/0xcd11f61c1413ea3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413ea34 expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.831763:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c303b84a00/0xcd11f61c1413ea3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413ea34 expref: 20 pid: 17138 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664449.831792:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875550140561920:0@lo:104: 00000100:00100000:3.0:1788664449.831852:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664449.831910:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c303b85400/0xcd11f61c1413ea2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413ea26 expref: 20 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.831918:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c303b85400/0xcd11f61c1413ea2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413ea26 expref: 20 pid: 17136 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664449.831927:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875550140562048:0@lo:104: 00000100:00100000:3.0:1788664449.831954:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664449.831973:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43535da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664449.831998:0:17127:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788664449.832016:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140561920 00000100:00100000:3.0:1788664449.832022:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140561920 00000100:00100000:3.0:1788664449.832054:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140562048 00000100:00100000:3.0:1788664449.832057:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140562048 00000100:00100000:3.0:1788664449.832071:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664449.832079:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+4:17159:x1875550140561920:12345-0@lo:104: 00010000:00010000:3.0:1788664449.832092:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413ea34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413ea3b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.832141:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788664449.832147:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+4:17159:x1875550140561920:12345-0@lo:104: Request processed in 69us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664449.832155:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664449.832171:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664449.832177:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+3:17159:x1875550140562048:12345-0@lo:104: 00010000:00010000:3.0:1788664449.832185:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4029e3800/0xcd11f61c1413ea26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413ea2d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.832214:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788664449.832224:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+3:17159:x1875550140562048:12345-0@lo:104: Request processed in 47us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664449.832230:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788664449.832265:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788664449.832271:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413ea34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413ea3b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.832278:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1788664449.832282:0:17131:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413ea34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413ea3b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.832291:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413ea34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413ea3b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664449.832297:0:17131:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413ea34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413ea3b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664449.832303:0:17131:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788664449.832329:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413ea34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413ea3b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.832336:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788664449.832355:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413ea34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413ea3b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.832361:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4029e2c00/0xcd11f61c1413ea34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413ea3b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.832371:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664449.832374:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4029e3800/0xcd11f61c1413ea26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413ea2d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.832388:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e3800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1788664449.832391:0:17131:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e3800/0xcd11f61c1413ea26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413ea2d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.832398:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4029e3800/0xcd11f61c1413ea26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413ea2d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664449.832404:0:17131:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e3800/0xcd11f61c1413ea26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413ea2d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664449.832410:0:17131:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788664449.832423:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4029e3800/0xcd11f61c1413ea26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413ea2d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.832429:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788664449.832434:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4029e3800/0xcd11f61c1413ea26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413ea2d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788664449.832942:0:18644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788664449.833659:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4029e3800/0xcd11f61c1413ea26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413ea2d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.833676:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664449.833678:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664449.833680:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664449.833686:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664449.833710:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140562176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788664449.833757:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664449.833809:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664449.833815:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140562304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788664449.833846:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664449.833882:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140562176 00000100:00100000:3.0:1788664449.833889:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140562176 00010000:00010000:3.0:1788664449.833911:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c303b84a00/0xcd11f61c1413ea3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413ea34 expref: 21 pid: 17138 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664449.833932:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140562304 00000100:00100000:3.0:1788664449.833935:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140562304 00010000:00010000:3.0:1788664449.833945:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c303b85400/0xcd11f61c1413ea2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413ea26 expref: 22 pid: 17136 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664449.833957:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664449.833964:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:3638:x1875550140562176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788664449.833975:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664449.833980:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c303b84a00/0xcd11f61c1413ea3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413ea34 expref: 22 pid: 17138 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.833990:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c303b84a00/0xcd11f61c1413ea3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413ea34 expref: 22 pid: 17138 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.834005:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664449.834035:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:3638:x1875550140562176:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664449.834042:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664449.834056:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664449.834062:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3038bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:3638:x1875550140562304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788664449.834069:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664449.834073:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c303b85400/0xcd11f61c1413ea2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413ea26 expref: 21 pid: 17136 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.834093:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c303b85400/0xcd11f61c1413ea2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413ea26 expref: 21 pid: 17136 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.834104:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eae3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.834112:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eae3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788664449.834126:0:17130:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007147744s 00010000:00010000:3.0:1788664449.834130:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eae3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.834137:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eae3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.834144:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eae3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.834150:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eae3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.834156:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ae00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664449.834161:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eae3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.834169:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eae3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.834177:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eae3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.834192:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664449.834215:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3038bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:3638:x1875550140562304:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664449.834221:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664449.834280:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140562304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788664449.834288:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140562176:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788664449.834315:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303b84a00/0xcd11f61c1413ea3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413ea34 expref: 20 pid: 17138 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664449.834323:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875550140561920:0@lo:104: 00010000:00010000:3.0:1788664449.834331:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303b85400/0xcd11f61c1413ea2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413ea26 expref: 19 pid: 17136 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664449.834338:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875550140562048:0@lo:104: 00010000:00010000:3.0:1788664449.834350:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eae3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.834359:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eae3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.834365:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eae3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664449.834371:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eae3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788664449.851018:0:18644:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788664449.851026:0:18644:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788664449.851063:0:18644:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788664449.851104:0:18644:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788664449.851373:0:18644:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788664449.851396:0:18644:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788664449.860629:0:18644:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788664449.861445:0:18644:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788664450.622236:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788664450.622266:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140562432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664450.622328:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664450.622401:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140562432 00000100:00100000:0.0:1788664450.622408:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140562432 00000100:00100000:0.0:1788664450.622465:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788664450.622474:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140562432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788664450.622506:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788664450.622550:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140562432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664450.622556:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788664450.623237:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140562432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664450.623662:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140562560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788664450.623702:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664450.623767:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140562560 00000100:00100000:0.0:1788664450.623805:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140562560 00000100:00100000:0.0:1788664450.623841:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788664450.623849:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140562560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788664450.623872:0:17883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788664450.629205:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140562560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788664450.630459:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140562560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6604us (6749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664450.630472:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1788664450.749876:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788664450.874197:0:18725:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788664450.874386:0:18725:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788664451.071062:0:17140:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788664451.071070:0:17140:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c42f768000 from 9 10000000:01000000:2.0:1788664451.071075:0:17140:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788664451.071119:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413eaea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.071130:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413eaea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.071141:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413eaea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664451.071235:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140562688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788664451.071305:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664451.071353:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f764240 going to sleep for 11 seconds 00000100:00100000:3.0:1788664451.071400:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140562688 00000100:00100000:3.0:1788664451.071408:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140562688 00000100:00100000:3.0:1788664451.071463:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788664451.071473:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+19:17140:x1875550140562688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664451.071486:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664451.071498:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eaf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413eaea expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664451.071521:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eaf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413eaea expref: 20 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664451.071532:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eaf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413eaea expref: 20 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664451.071540:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502ae00, rc 0) 00000100:00100000:3.0:1788664451.071580:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+20:17140:x1875550140562688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664451.071586:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788664451.072304:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140562688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664451.072321:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413eaea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eaf1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.072330:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413eaea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413eaf1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664451.072382:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140562816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788664451.072419:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664451.072451:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f764240 going to sleep for 11 seconds 00000100:00100000:3.0:1788664451.074277:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140562816 00000100:00100000:3.0:1788664451.074289:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140562816 00000100:00100000:3.0:1788664451.074333:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788664451.074342:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4199bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+20:17140:x1875550140562816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788664451.074365:0:17137:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788664451.074380:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788664451.074382:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788664451.074483:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4199bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+20:17140:x1875550140562816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664451.074491:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788664451.080985:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140562816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788664451.081065:0:17140:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788664451.081075:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413eaea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eaf1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.081093:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413eaea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eaf1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664451.081102:0:17140:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788664451.081105:0:17140:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c43f740000 from 9 10000000:01000000:2.0:1788664451.081107:0:17140:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788664451.081137:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413eaf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.081144:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413eaf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.081153:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413eaf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664451.081182:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140562944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788664451.081231:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664451.081262:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f764240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664451.081280:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140562944 00000100:00100000:2.0:1788664451.081285:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140562944 00000100:00100000:2.0:1788664451.081321:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788664451.081328:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4199bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+20:17140:x1875550140562944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664451.081339:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664451.081350:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4029e2c00/0xcd11f61c1413eaff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413eaf8 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.081370:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e2c00/0xcd11f61c1413eaff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413eaf8 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.081389:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4029e2c00/0xcd11f61c1413eaff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413eaf8 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.081397:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e2c00, rc 0) 00000100:00100000:2.0:1788664451.081427:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4199bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:17140:x1875550140562944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664451.081433:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788664451.081464:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140562944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664451.081474:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413eaf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eaff expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.081482:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413eaf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413eaff expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664451.081515:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140563072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788664451.081538:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664451.081550:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c43f764240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664451.081561:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140563072 00000100:00100000:2.0:1788664451.081563:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140563072 00000100:00100000:2.0:1788664451.081581:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788664451.081586:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4199bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:17140:x1875550140563072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788664451.081608:0:17136:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788664451.081622:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788664451.081625:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788664451.081693:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4199bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:17140:x1875550140563072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664451.081707:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788664451.081733:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140563072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788664451.081764:0:17140:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788664451.085716:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413eaf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eaff expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.085739:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413eaf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eaff expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788664451.198425:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788664451.775892:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664452.800973:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664453.828054:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664454.850717:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788664455.232600:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788664455.232607:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788664455.232610:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788664455.232613:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788664455.232642:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788664455.232645:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788664455.232647:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1788664455.232649:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140563200:0@lo:400:kworker.0 00000100:00080000:2.0:1788664455.232650:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788664455.232681:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140563456:0@lo:400:kworker.0 00000100:00100000:3.0:1788664455.232724:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664455.232724:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664455.235528:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140563712:0@lo:400:kworker.0 00000100:00100000:2.0:1788664455.235684:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140563968:0@lo:400:kworker.0 00000100:00100000:2.0:1788664455.235740:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664455.235787:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664455.235794:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140563584:0@lo:400:kworker.0 00000100:00100000:2.0:1788664455.235827:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664455.236223:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664455.236324:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788664455.236333:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140563328:0@lo:400:kworker.0 00000100:00100000:3.0:1788664455.236357:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664455.236375:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140563840:0@lo:400:kworker.0 00000100:00100000:3.0:1788664455.236398:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664455.236437:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140563456 00000100:00100000:3.0:1788664455.236444:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140563456 00000100:00100000:3.0:1788664455.236477:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140563968 00000100:00100000:3.0:1788664455.236481:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140563968 00000100:00100000:3.0:1788664455.236503:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140563712 00000100:00100000:3.0:1788664455.236505:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140563712 00000100:00100000:3.0:1788664455.236515:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140563840 00000100:00100000:3.0:1788664455.236524:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140563840 00000100:00100000:3.0:1788664455.236859:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788664455.236872:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140563456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664455.236932:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140563456:12345-0@lo:400:kworker.0 Request processed in 63us (4207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664455.239214:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788664455.239327:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788664455.239361:0:17145:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788664455.239369:0:17145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788664455.239391:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140563200 00000100:00100000:3.0:1788664455.239400:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140563200 00000100:00100000:3.0:1788664455.239437:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788664455.239444:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4199be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:3638:x1875550140563200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664455.239526:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4199be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:3638:x1875550140563200:12345-0@lo:400:kworker.0 Request processed in 81us (6801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664455.239532:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788664455.239645:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140563584 00000100:00100000:3.0:1788664455.239650:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140563584 00000100:00100000:3.0:1788664455.239671:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140563328 00000100:00100000:3.0:1788664455.239674:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140563328 00000100:00100000:0.0:1788664455.239700:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140563968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664455.239740:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140563968:12345-0@lo:400:kworker.0 Request processed in 515us (4000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664455.239746:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788664455.239760:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664455.239766:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140563712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664455.239810:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140563712:12345-0@lo:400:kworker.0 Request processed in 44us (3587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664455.239815:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664455.239826:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664455.239832:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140563840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664455.239856:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140563840:12345-0@lo:400:kworker.0 Request processed in 25us (3457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664455.239861:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664455.239886:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788664455.239892:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140563584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664455.239923:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140563584:12345-0@lo:400:kworker.0 Request processed in 32us (4096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664455.239928:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788664455.240002:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788664455.240009:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140563328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664455.240040:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140563328:12345-0@lo:400:kworker.0 Request processed in 32us (3683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664455.240047:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788664455.240080:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664455.240084:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788664455.240389:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140563328:0@lo:400:kworker.0 00010000:00080000:3.0:1788664455.240408:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c3039ca300 x1875550140563840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664455.240426:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140563840:0@lo:400:kworker.0 00010000:00080000:3.0:1788664455.240440:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c3039c8e00 x1875550140563712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664455.240449:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140563712:0@lo:400:kworker.0 00000100:00100000:3.0:1788664455.240458:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140563200:0@lo:400:kworker.0 00000100:00100000:2.0:1788664455.244049:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140563584:0@lo:400:kworker.0 00010000:00080000:2.0:1788664455.244069:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c3039c9c00 x1875550140563456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664455.244080:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140563456:0@lo:400:kworker.0 00010000:00080000:2.0:1788664455.244092:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c3039cad80 x1875550140563968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664455.244100:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140563968:0@lo:400:kworker.0 00000100:00100000:3.0:1788664455.741911:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664455.741939:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140564096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788664455.742005:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664455.742051:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140564096 00000100:00100000:3.0:1788664455.742058:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140564096 00000100:00100000:3.0:1788664455.742099:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788664455.742107:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140564096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788664455.742139:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788664455.742183:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140564096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664455.742189:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788664455.742231:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140564096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788664455.742595:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140564224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664455.742622:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664455.742693:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140564224 00000100:00100000:0.0:1788664455.742697:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140564224 00000100:00100000:0.0:1788664455.742730:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788664455.742738:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140564224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788664455.742757:0:17883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788664455.749047:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140564224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6299us (6413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664455.749063:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788664455.752904:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140564224:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788664455.871652:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788664455.881715:0:19016:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1788664456.892539:0:19068:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788664456.892999:0:19068:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788664456.895397:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788664457.662436:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788664457.797213:0:19118:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788664457.797503:0:19118:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788664457.918984:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664458.942477:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664459.970174:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664460.032690:0:3635:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664445/real 1788664445] req@ffff93c4350fe300 x1875550140558464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664460 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664460.032725:0:3635:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c4350fe300 x1875550140558464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664460 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664460.032738:0:3635:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664445/real 1788664445] req@ffff93c4350fea00 x1875550140558592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664460 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664460.032754:0:3635:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c4350fea00 x1875550140558592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664460 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788664460.032793:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c3041b1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788664460.032816:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788664460.032821:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140558464:0@lo:8:kworker.0 00000100:00080000:0.0:1788664460.032829:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c30256e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788664460.032834:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788664460.032837:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140558592:0@lo:8:kworker.0 00000100:00080000:0.0:1788664460.036311:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788664460.036317:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788664460.036320:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788664460.036323:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788664460.036338:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788664460.036341:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788664460.036344:0:36:0:(import.c:65:import_set_state_nolock()) ffff93c3041b1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788664460.036395:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140564736:0@lo:400:kworker.0 00000100:00100000:3.0:1788664460.036479:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664460.036551:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664460.036558:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140564352:0@lo:400:kworker.0 00000100:00100000:3.0:1788664460.036597:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664460.036635:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140564480:0@lo:400:kworker.0 00000100:00100000:3.0:1788664460.036662:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664460.036689:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664460.036694:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140564736 00000100:00100000:3.0:1788664460.036697:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140564608:0@lo:400:kworker.0 00000100:00100000:2.0:1788664460.036703:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140564736 00000100:00100000:3.0:1788664460.036728:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664460.036752:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140564480 00000100:00100000:2.0:1788664460.036756:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140564480 00000100:00100000:3.0:1788664460.036792:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788664460.036810:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140564736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664460.036814:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788664460.036826:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140564480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664460.036874:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140564736:12345-0@lo:400:kworker.0 Request processed in 68us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664460.036882:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788664460.036890:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140564480:12345-0@lo:400:kworker.0 Request processed in 66us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664460.036900:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788664460.036912:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140564352 00000100:00100000:3.0:1788664460.036917:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140564352 00000100:00100000:3.0:1788664460.036950:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788664460.036958:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:3638:x1875550140564352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664460.036990:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:3638:x1875550140564352:12345-0@lo:400:kworker.0 Request processed in 33us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664460.036997:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788664460.037031:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140564608 00000100:00100000:3.0:1788664460.037035:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140564608 00000100:00100000:3.0:1788664460.037065:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788664460.037072:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140564608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664460.037102:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140564608:12345-0@lo:400:kworker.0 Request processed in 31us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664460.037118:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788664460.037155:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c303add880 x1875550140564608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664460.037170:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140564608:0@lo:400:kworker.0 00000100:00100000:3.0:1788664460.037181:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140564480:0@lo:400:kworker.0 00000100:00100000:3.0:1788664460.037204:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140564352:0@lo:400:kworker.0 00000100:00100000:3.0:1788664460.037212:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140564736:0@lo:400:kworker.0 00000100:00080000:0.0:1788664460.043959:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 540 00000100:00080000:0.0:1788664460.043968:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788664460.043976:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93c3041b1000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788664460.044015:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c303adce00 x1875550140564864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788664460.044038:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788664460.044043:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788664460.044046:0:36:0:(import.c:65:import_set_state_nolock()) ffff93c30256e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788664460.044050:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 540 00000100:00080000:0.0:1788664460.044053:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788664460.044057:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93c30256e800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788664460.044079:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c303adf480 x1875550140564992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788664460.044159:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140565120:0@lo:400:kworker.0 00000100:00100000:0.0:1788664460.044222:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664460.044271:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140565376:0@lo:400:kworker.0 00000100:00100000:0.0:1788664460.044300:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664460.044321:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664460.044327:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140565248:0@lo:400:kworker.0 00000100:00100000:0.0:1788664460.044349:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664460.044386:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140565120 00000100:00100000:0.0:1788664460.044392:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140565120 00000100:00100000:0.0:1788664460.044435:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140565376 00000100:00100000:0.0:1788664460.044438:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140565376 00000100:00100000:0.0:1788664460.044476:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140565248 00000100:00100000:0.0:1788664460.044479:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140565248 00000100:00100000:0.0:1788664460.044497:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788664460.044506:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140565120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664460.044565:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140565120:12345-0@lo:400:kworker.0 Request processed in 60us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664460.044571:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788664460.045556:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788664460.045569:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140565376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664460.045635:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140565376:12345-0@lo:400:kworker.0 Request processed in 70us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664460.045642:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788664460.045660:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788664460.045667:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140565248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664460.045699:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140565248:12345-0@lo:400:kworker.0 Request processed in 33us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664460.045706:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788664460.046211:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664460.046216:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788664460.046246:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c303adc000 x1875550140565120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664460.046260:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140565120:0@lo:400:kworker.0 00010000:00080000:0.0:1788664460.046291:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c303addc00 x1875550140565248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664460.046314:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140565248:0@lo:400:kworker.0 00010000:00080000:0.0:1788664460.046325:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c303adea00 x1875550140565376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664460.046333:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140565376:0@lo:400:kworker.0 00000100:00100000:0.0:1788664460.046370:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140564864:0@lo:8:kworker.0 00000100:00100000:0.0:1788664460.046402:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664460.046437:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140564992:0@lo:8:kworker.0 00000100:00100000:0.0:1788664460.046469:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664460.048069:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140564864 00000100:00100000:1.0:1788664460.048149:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140564864 00000100:00100000:1.0:1788664460.048195:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140564992 00000100:00100000:1.0:1788664460.048199:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140564992 00000100:00100000:1.0:1788664460.048219:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664460.048228:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1875550140564864:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788664460.048260:0:18648:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:1.0:1788664460.048293:0:18648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd11f61c1413eb06 00002000:00100000:1.0:1788664460.048307:0:18648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff93c304362000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788664460.048312:0:18648:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788664460.048315:0:18648:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788664460.048580:0:18648:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788664460.048605:0:18648:0:(import.c:65:import_set_state_nolock()) ffff93c304365800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664460.048678:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1875550140564864:12345-0@lo:8:kworker.0 Request processed in 451us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664460.048686:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664460.048709:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788664460.048713:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1875550140564992:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788664460.048726:0:18648:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788664460.050864:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c303adce00 x1875550140564864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788664480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664460.050880:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788664460.050890:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788664460.050898:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788664460.050904:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788664460.050907:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c3041b1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788664460.050924:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788664460.050931:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140564864:0@lo:8:kworker.0 00000004:00080000:0.0:1788664460.050988:0:17885:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788664460.051007:0:17885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875550140565632:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788664460.051057:0:17885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664460.051080:0:17885:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4068b66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664460.051091:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788664460.051101:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140565504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664460.051139:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664460.051169:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788664460.051175:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788664460.051203:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140565504 00000100:00100000:0.0:1788664460.051208:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140565504 00000100:00100000:0.0:1788664460.051248:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664460.051256:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1875550140565504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788664460.051279:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788664460.051314:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1875550140565504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664460.051320:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788664460.051337:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788664460.051425:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c303adce00 x1875550140565504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664460.051440:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140565504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664460.052579:0:18649:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788664460.052658:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140565632 00000100:00100000:3.0:1788664460.052664:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140565632 00000004:00080000:3.0:1788664460.052699:0:17884:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788664460.052797:0:17884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 555190025637ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788664460.052804:0:17884:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788664460.062734:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664460.062759:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17885:x1875550140565632:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788664460.072705:0:17875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1788664460.076726:0:19229:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788664460.076739:0:19229:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788664460.077028:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17885:x1875550140565632:12345-0@lo:7:osp-pre-0-1.0 Request processed in 14271us (25966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664460.077044:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788664460.077117:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c303adc000 x1875550140565632/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788664476 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664460.077132:0:17885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875550140565632:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788664460.077147:0:17885:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788664460.077186:0:17885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875550140565760:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788664460.077219:0:17885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664460.077280:0:17885:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c40542e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664460.077317:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140565760 00000100:00100000:3.0:1788664460.077324:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140565760 00000100:00100000:3.0:1788664460.078247:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788664460.078261:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17885:x1875550140565760:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788664460.078289:0:18649:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788664460.078396:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17885:x1875550140565760:12345-0@lo:5:osp-pre-0-1.0 Request processed in 140us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664460.078404:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788664460.078936:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c303adc000 x1875550140565760/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788664476 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664460.078969:0:17885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875550140565760:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788664460.078982:0:17885:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788664460.079021:0:17885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875550140565888:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788664460.079056:0:17885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664460.079086:0:17885:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412c5f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664460.079137:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140565888 00000100:00100000:0.0:1788664460.079144:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140565888 00000100:00100000:0.0:1788664460.079183:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664460.079198:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17885:x1875550140565888:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788664460.079226:0:19229:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1788664460.079428:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1875550140564992:12345-0@lo:8:kworker.0 Request processed in 30712us (32956us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788664460.079437:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788664460.079472:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c30256e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788664460.079477:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788664460.079480:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140564992:0@lo:8:kworker.0 00000001:00080000:3.0:1788664460.103150:0:18645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788664460.103167:0:18645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788664460.108676:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17885:x1875550140565888:12345-0@lo:5:osp-pre-0-1.0 Request processed in 29360us (29499us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788664460.108689:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788664460.108921:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c3039cad80 x1875550140565888/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788664476 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664460.108932:0:17885:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788664460.108938:0:17885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875550140565888:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788664460.108953:0:17885:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788664460.109000:0:17885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17885:1875550140566016:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788664460.109036:0:17885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664460.109106:0:17885:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412c5f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664460.114933:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140566016 00000100:00100000:0.0:1788664460.114944:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140566016 00000100:00100000:0.0:1788664460.115088:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788664460.115099:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17885:x1875550140566016:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788664460.115200:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17885:x1875550140566016:12345-0@lo:900:osp-pre-0-1.0 Request processed in 102us (6162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664460.115208:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788664460.115280:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c3039cad80 x1875550140566016/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788664476 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664460.115295:0:17885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17885:1875550140566016:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788664460.873017:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140566272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664460.873087:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664460.875002:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140566144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664460.875067:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664460.875134:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140566272 00000100:00100000:3.0:1788664460.875141:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140566272 00000100:00100000:3.0:1788664460.875176:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140566144 00000100:00100000:3.0:1788664460.875179:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140566144 00000100:00100000:3.0:1788664460.875195:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788664460.875203:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140566272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788664460.875235:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788664460.875349:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788664460.875359:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140566144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788664460.875378:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788664460.875434:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140566144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664460.875441:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788664460.881061:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140566272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5848us (7964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664460.881077:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788664460.881154:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140566144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664460.881665:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140566272:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788664460.996257:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788664461.439243:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788664462.015135:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664463.037969:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664464.062165:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788664464.591928:0:19464:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:0.0:1788664464.591935:0:19464:0:(obd_mount.c:924:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788664464.591937:0:19464:0:(obd_mount.c:927:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788664464.592133:0:19464:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c3039b7800 00000020:01000004:0.0:1788664464.592157:0:19464:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788664464.592177:0:19464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788664464.592196:0:19464:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93c4306ab380) 00000020:00000080:0.0:1788664464.592219:0:19464:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788664464.662159:0:19464:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788664464.673752:0:19464:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788664464.674735:0:19464:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788664464.676219:0:19464:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788664464.676751:0:19464:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788664464.678245:0:19464:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788664464.678444:0:19464:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1788664464.680033:0:19464:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788664464.680247:0:19464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788664464.680261:0:19464:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788664464.680273:0:19464:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd11f61c1413eb14 00000020:01000004:2.0:1788664464.680279:0:19464:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788664464.680300:0:19464:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788664464.680303:0:19464:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788664464.680309:0:19464:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788664464.680336:0:19464:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788664464.680341:0:19464:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788664464.705137:0:19464:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788664464.705187:0:19464:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788664464.705191:0:19464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788664464.705193:0:19464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788664464.705195:0:19464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664464.705196:0:19464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664464.705197:0:19464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664464.705199:0:19464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664464.705200:0:19464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788664464.705202:0:19464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664464.705203:0:19464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788664464.705206:0:19464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788664464.705208:0:19464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788664464.705210:0:19464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788664464.705211:0:19464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664464.705212:0:19464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664464.705213:0:19464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664464.705214:0:19464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664464.705215:0:19464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788664464.705216:0:19464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664464.705217:0:19464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788664464.705246:0:19464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788664464.705267:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140566400:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788664464.705338:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664464.705388:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c40542e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788664464.705567:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140566400 00000100:00100000:2.0:1788664464.705575:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140566400 00000100:00100000:2.0:1788664464.705623:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788664464.705631:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:19464:x1875550140566400:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788664464.705658:0:17138:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788664464.705661:0:17138:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788664464.705665:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788664464.708961:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:19464:x1875550140566400:12345-0@lo:253:mount.lustre.0 Request processed in 3322us (3614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664464.708985:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788664464.709221:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140566400:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788664464.709235:0:19464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788664464.709252:0:19464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788664464.709254:0:19464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788664464.709255:0:19464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664464.709256:0:19464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664464.709257:0:19464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664464.709258:0:19464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664464.709260:0:19464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788664464.709261:0:19464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664464.709262:0:19464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788664464.709283:0:19464:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c3039b7800 from lustre-OST0001 10000000:01000000:3.0:1788664464.709320:0:19464:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788664464.709323:0:19464:0:(mgc_request.c:327:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788664464.709332:0:19464:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93c412cacd40 local copy 00010000:00010000:3.0:1788664464.709341:0:19464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e835 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664464.709435:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140566528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788664464.709473:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664464.709524:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406b8e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664464.709684:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140566528 00000100:00100000:2.0:1788664464.709693:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140566528 00000100:00100000:2.0:1788664464.709734:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788664464.709742:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:19464:x1875550140566528:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664464.709841:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:19464:x1875550140566528:12345-0@lo:501:mount.lustre.0 Request processed in 99us (367us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788664464.709848:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788664464.709976:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140566528:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788664464.709991:0:19464:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788664464.710010:0:19464:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788664464.710017:0:19464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e835 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.710026:0:19464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e3e00/0xcd11f61c1413e82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413e835 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664464.710048:0:19464:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c3039b7800 10000000:01000000:1.0:1788664464.710053:0:19464:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788664464.710058:0:19464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788664464.710078:0:19464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788664464.710083:0:19464:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788664464.710086:0:19464:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788664464.710117:0:19464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85400/0xcd11f61c1413eb1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.710126:0:19464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b85400/0xcd11f61c1413eb1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.710134:0:19464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b85400/0xcd11f61c1413eb1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664464.710148:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140566656:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788664464.710176:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664464.718799:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406328300 going to sleep for 11 seconds 00000100:00100000:3.0:1788664464.723371:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140566656 00000100:00100000:3.0:1788664464.723387:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140566656 00000100:00100000:3.0:1788664464.723454:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788664464.723464:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:19464:x1875550140566656:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788664464.723480:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664464.723498:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40502be00/0xcd11f61c1413eb22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413eb1b expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664464.723538:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40502be00/0xcd11f61c1413eb22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413eb1b expref: 22 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664464.723549:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40502be00/0xcd11f61c1413eb22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413eb1b expref: 22 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664464.723576:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502be00, rc 0) 00000100:00100000:3.0:1788664464.723644:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:19464:x1875550140566656:12345-0@lo:101:mount.lustre.0 Request processed in 182us (13466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664464.723651:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788664464.723837:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140566656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664464.723854:0:19464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b85400/0xcd11f61c1413eb1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eb22 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664464.723864:0:19464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b85400/0xcd11f61c1413eb1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413eb22 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788664464.725300:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788664464.726341:0:19464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788664464.729602:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788664464.729663:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788664464.731265:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788664464.731307:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788664464.731324:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788664464.731339:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788664464.731367:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788664464.731373:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788664464.731474:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140566784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664464.731553:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664464.731594:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c40385e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664464.732171:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140566784 00000100:00100000:3.0:1788664464.732180:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140566784 00000100:00100000:3.0:1788664464.732223:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788664464.732232:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:19464:x1875550140566784:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788664464.732390:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:19464:x1875550140566784:12345-0@lo:501:mount.lustre.0 Request processed in 158us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664464.732397:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788664464.732733:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140566784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664464.732768:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140566912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788664464.732853:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664464.734082:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c40385e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788664464.736959:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140566912 00000100:00100000:2.0:1788664464.737033:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140566912 00000100:00100000:2.0:1788664464.737104:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788664464.737115:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:19464:x1875550140566912:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788664464.739719:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:19464:x1875550140566912:12345-0@lo:503:mount.lustre.0 Request processed in 2599us (6859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664464.739733:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788664464.744022:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140566912:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788664464.744446:0:19464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788664464.744557:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567040:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664464.744627:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664464.745781:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42b0cc540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664464.747143:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140567040 00000100:00100000:2.0:1788664464.747154:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140567040 00000100:00100000:3.0:1788664464.747399:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788664464.747410:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:19464:x1875550140567040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788664464.749141:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:19464:x1875550140567040:12345-0@lo:502:mount.lustre.0 Request processed in 1728us (4508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664464.749153:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788664464.749322:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567040:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788664464.749567:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788664464.749600:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788664464.749615:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788664464.749640:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788664464.749665:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788664464.749960:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788664464.750043:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788664464.750058:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788664464.750070:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788664464.750104:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664464.750160:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664464.750205:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c40385ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788664464.750334:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140567168 00000100:00100000:3.0:1788664464.750341:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140567168 00000100:00100000:3.0:1788664464.750376:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788664464.750385:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:19464:x1875550140567168:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788664464.750826:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:19464:x1875550140567168:12345-0@lo:502:mount.lustre.0 Request processed in 440us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664464.750834:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788664464.751277:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788664464.751334:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788664464.751345:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788664464.753950:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788664464.754071:0:19468:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788664464.754079:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664464.754081:0:19468:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788664464.754089:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788664464.754104:0:19468:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93c435370000) 00000020:00000080:3.0:1788664464.754129:0:19468:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788664464.754133:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788664464.754201:0:19468:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c3039b7800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788664464.754208:0:19468:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788664464.754214:0:19468:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd11f61c1413eb30 00010000:00010000:3.0:1788664464.764399:0:19468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788664464.765499:0:19468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1788664464.767656:0:19468:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788664464.772817:0:19468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788664464.772830:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664464.772836:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664464.772839:0:19468:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788664464.772842:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664464.772846:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664464.772848:0:19468:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788664464.772851:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788664464.772853:0:19468:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788664464.772856:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664464.772859:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664464.772860:0:19468:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788664464.772863:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664464.772866:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664464.772867:0:19468:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788664464.772869:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788664464.772917:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664464.772921:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664464.772922:0:19468:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788664464.772925:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788664464.773159:0:19464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788664464.773188:0:19464:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788664464.773213:0:19464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85400/0xcd11f61c1413eb1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eb22 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.773226:0:19464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b85400/0xcd11f61c1413eb1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eb22 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664464.773235:0:19464:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c3039b7800 from 1 10000000:01000000:1.0:1788664464.773238:0:19464:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664464.773271:0:19464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84a00/0xcd11f61c1413eb37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.773280:0:19464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b84a00/0xcd11f61c1413eb37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.773290:0:19464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b84a00/0xcd11f61c1413eb37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664464.773322:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788664464.773386:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664464.773423:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406328300 going to sleep for 11 seconds 00000100:00100000:3.0:1788664464.773836:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140567296 00000100:00100000:3.0:1788664464.773843:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140567296 00000100:00100000:3.0:1788664464.775981:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788664464.776000:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:19464:x1875550140567296:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788664464.776017:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664464.776034:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c40502b200/0xcd11f61c1413eb3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413eb37 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664464.776064:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40502b200/0xcd11f61c1413eb3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413eb37 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664464.776075:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c40502b200/0xcd11f61c1413eb3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413eb37 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664464.776084:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c40502b200, rc 0) 00000100:00100000:3.0:1788664464.776165:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:19464:x1875550140567296:12345-0@lo:101:mount.lustre.0 Request processed in 173us (2779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664464.776173:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788664464.777542:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567296:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664464.777570:0:19464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b84a00/0xcd11f61c1413eb37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eb3e expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664464.777581:0:19464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b84a00/0xcd11f61c1413eb37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413eb3e expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788664464.785988:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788664464.786267:0:19464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788664464.786460:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788664464.786486:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788664464.786505:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788664464.786522:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788664464.786589:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567424:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664464.786647:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664464.786805:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140567424 00000100:00100000:1.0:1788664464.786812:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140567424 00000100:00100000:1.0:1788664464.786854:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788664464.786863:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:19464:x1875550140567424:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664464.787116:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:19464:x1875550140567424:12345-0@lo:501:mount.lustre.0 Request processed in 253us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664464.787124:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788664464.788967:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4123c1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788664464.789009:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567424:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664464.789064:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567552:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788664464.789133:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664464.789737:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4123c1900 going to sleep for 11 seconds 00000100:00100000:3.0:1788664464.793203:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140567552 00000100:00100000:3.0:1788664464.793216:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140567552 00000100:00100000:3.0:1788664464.793306:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788664464.793316:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:19464:x1875550140567552:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788664464.793475:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:19464:x1875550140567552:12345-0@lo:503:mount.lustre.0 Request processed in 161us (4341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664464.793484:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788664464.793580:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567552:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788664464.794022:0:19464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788664464.794098:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664464.794145:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664464.794487:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4123c13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664464.794574:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140567680 00000100:00100000:2.0:1788664464.794580:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140567680 00000100:00100000:2.0:1788664464.794608:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788664464.794615:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:19464:x1875550140567680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788664464.794718:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:19464:x1875550140567680:12345-0@lo:502:mount.lustre.0 Request processed in 102us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664464.794725:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788664464.795021:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788664464.795200:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788664464.795229:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788664464.795244:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788664464.795259:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788664464.795274:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788664464.795287:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788664464.795300:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788664464.795327:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788664464.795343:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788664464.795355:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788664464.795367:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788664464.795404:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664464.795446:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664464.795478:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4123c13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664464.797095:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140567808 00000100:00100000:2.0:1788664464.797107:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140567808 00000100:00100000:2.0:1788664464.797161:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788664464.797170:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:19464:x1875550140567808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788664464.797321:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:19464:x1875550140567808:12345-0@lo:502:mount.lustre.0 Request processed in 152us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664464.797329:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788664464.797449:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567808:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788664464.797536:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788664464.797549:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788664464.799528:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664464.799542:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664464.799544:0:19472:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788664464.799552:0:19472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c3039b7800 00000020:00000080:3.0:1788664464.799565:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788664464.799574:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664464.799576:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664464.799578:0:19472:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788664464.799580:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664464.799583:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664464.799584:0:19472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788664464.799587:0:19472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c3039b7800 00000020:00000080:3.0:1788664464.799589:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788664464.799645:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664464.799648:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664464.799649:0:19472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788664464.799652:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664464.799654:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664464.799655:0:19472:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788664464.799658:0:19472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c3039b7800 00000020:00000080:3.0:1788664464.799660:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788664464.799685:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664464.799688:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664464.799689:0:19472:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788664464.799691:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664464.799693:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664464.799694:0:19472:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788664464.799698:0:19472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c3039b7800 00000020:00000080:3.0:1788664464.799700:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788664464.799720:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664464.799722:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664464.799724:0:19472:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788664464.799727:0:19472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788664464.800060:0:19464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788664464.800087:0:19464:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788664464.800111:0:19464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84a00/0xcd11f61c1413eb37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eb3e expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664464.800133:0:19464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b84a00/0xcd11f61c1413eb37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eb3e expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664464.800192:0:19464:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788664464.800195:0:19464:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff93c3039b7800 10000000:01000000:2.0:1788664464.800199:0:19464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c3039b7800 10000000:01000000:2.0:1788664464.800203:0:19464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788664464.800208:0:19464:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93c3039b7800 from 1 10000000:01000000:2.0:1788664464.800211:0:19464:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788664464.800241:0:19464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413eb45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664464.800250:0:19464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413eb45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664464.800260:0:19464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413eb45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664464.800285:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788664464.800342:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664464.800381:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140567936 00000100:00100000:2.0:1788664464.800387:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140567936 00000100:00100000:2.0:1788664464.800426:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788664464.800434:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:19464:x1875550140567936:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788664464.800445:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664464.800457:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4029e3800/0xcd11f61c1413eb4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413eb45 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664464.800491:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e3800/0xcd11f61c1413eb4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413eb45 expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664464.800502:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4029e3800/0xcd11f61c1413eb4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413eb45 expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664464.800524:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e3800, rc 0) 00000100:00100000:2.0:1788664464.800557:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:19464:x1875550140567936:12345-0@lo:101:mount.lustre.0 Request processed in 124us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664464.800564:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788664464.800609:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412d91600 going to sleep for 11 seconds 00000100:00100000:2.0:1788664464.800629:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140567936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788664464.800643:0:19464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413eb45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eb4c expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664464.800652:0:19464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413eb45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413eb4c expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788664464.814210:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1788664464.814544:0:19464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788664464.815034:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788664464.815060:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788664464.815076:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788664464.815090:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788664464.815104:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788664464.815119:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788664464.815134:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788664464.815150:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788664464.815177:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788664464.815191:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788664464.815204:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788664464.815219:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788664464.815234:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788664464.815249:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788664464.815283:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788664464.815299:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788664464.815313:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788664464.815326:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788664464.815340:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788664464.815356:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788664464.815371:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788664464.815383:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788664464.815395:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788664464.815423:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788664464.815440:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788664464.815455:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788664464.815469:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788664464.815482:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788664464.815495:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788664464.815521:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788664464.815552:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788664464.815569:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788664464.815584:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788664464.815599:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788664464.815611:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788664464.815624:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788664464.815638:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788664464.815653:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788664464.815668:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1788664464.816527:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1788664464.816549:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1788664464.816577:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1788664464.816592:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1788664464.816606:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1788664464.816620:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1788664464.816635:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1788664464.817643:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1788664464.817659:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1788664464.818038:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140568064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664464.818099:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664464.818990:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412d913c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664464.825893:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140568064 00000100:00100000:0.0:1788664464.825908:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140568064 00000100:00100000:0.0:1788664464.825979:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788664464.825990:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c403ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:19464:x1875550140568064:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664464.826169:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c403ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:19464:x1875550140568064:12345-0@lo:501:mount.lustre.0 Request processed in 180us (8068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664464.826177:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788664464.829561:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140568064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664464.829624:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140568192:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788664464.829698:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664464.829744:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412d913c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664464.830161:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140568192 00000100:00100000:3.0:1788664464.830169:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140568192 00000100:00100000:3.0:1788664464.830221:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788664464.830231:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c403ec5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:19464:x1875550140568192:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788664464.830351:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c403ec5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:19464:x1875550140568192:12345-0@lo:503:mount.lustre.0 Request processed in 121us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664464.830359:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788664464.830441:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140568192:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788664464.831072:0:19464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788664464.831145:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140568320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788664464.831191:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664464.831214:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412d91600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664464.831278:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140568320 00000100:00100000:3.0:1788664464.831284:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140568320 00000100:00100000:3.0:1788664464.831319:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788664464.831329:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c403ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:19464:x1875550140568320:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788664464.831424:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c403ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:19464:x1875550140568320:12345-0@lo:502:mount.lustre.0 Request processed in 96us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664464.831432:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788664464.831538:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140568320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788664464.831710:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788664464.831734:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788664464.831745:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788664464.831767:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788664464.831970:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788664464.831984:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788664464.831998:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788664464.832026:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788664464.832040:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788664464.832051:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788664464.832061:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788664464.832073:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788664464.832085:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788664464.832111:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788664464.832127:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788664464.832140:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788664464.832153:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788664464.832166:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788664464.832180:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788664464.832192:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788664464.832205:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788664464.832218:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788664464.832231:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788664464.832243:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788664464.832254:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788664464.832265:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788664464.832277:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788664464.832290:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788664464.832301:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788664464.832325:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788664464.832340:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788664464.832352:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788664464.832366:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788664464.832379:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788664464.832391:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788664464.832403:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788664464.832414:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788664464.832427:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788664464.832439:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788664464.832452:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788664464.832477:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788664464.832490:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788664464.832503:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788664464.832529:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788664464.832543:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788664464.832571:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788664464.832587:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788664464.832602:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788664464.832645:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140568448:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788664464.832700:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664464.832727:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412d91600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664464.832908:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140568448 00000100:00100000:3.0:1788664464.832915:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140568448 00000100:00100000:3.0:1788664464.832954:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788664464.832963:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c403ec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:19464:x1875550140568448:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788664464.833058:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c403ec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:19464:x1875550140568448:12345-0@lo:502:mount.lustre.0 Request processed in 96us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664464.833066:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788664464.833219:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140568448:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788664464.833376:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788664464.833399:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788664464.833420:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140568576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788664464.833454:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664464.833518:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412d91600 going to sleep for 11 seconds 00000100:00100000:1.0:1788664464.837156:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140568576 00000100:00100000:1.0:1788664464.837169:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140568576 00000100:00100000:1.0:1788664464.837219:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788664464.837229:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c403ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:19464:x1875550140568576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664464.837381:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c403ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:19464:x1875550140568576:12345-0@lo:502:mount.lustre.0 Request processed in 153us (3925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664464.837389:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788664464.837491:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140568576:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788664464.837581:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788664464.837597:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788664464.843682:0:19477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788664464.843715:0:19477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93c302738000) 00000020:00000080:1.0:1788664464.843745:0:19477:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788664464.843986:0:19477:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c3039b7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788664464.843993:0:19477:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c3039b7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788664464.843995:0:19477:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c3039b7800 3 00010000:00080000:1.0:1788664464.844025:0:19477:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c435284800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788664464.846396:0:19477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788664464.846639:0:19477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788664464.846689:0:19477:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788664464.846702:0:19477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcd11f61c1413eb5a 00000100:00080000:1.0:1788664464.846712:0:19477:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788664464.846719:0:19477:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93c435284800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788664464.846755:0:19477:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c30480ce00 x1875550140568704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788664464.846833:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1875550140568704:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788664464.846901:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664464.846965:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140568704 00000100:00100000:1.0:1788664464.846972:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140568704 00000100:00100000:1.0:1788664464.847006:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788664464.847012:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1875550140568704:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788664464.847034:0:18960:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:1.0:1788664464.847061:0:18960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcd11f61c1413eb61 00000004:00100000:1.0:1788664464.847074:0:18960:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788664464.847114:0:18960:0:(import.c:65:import_set_state_nolock()) ffff93c30264d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664464.847168:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875550140568704:12345-0@lo:38:llog_process_th.0 Request processed in 153us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664464.847175:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788664464.847212:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c30480ce00 x1875550140568704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664464.847222:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664464.847229:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788664464.847235:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788664464.847239:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788664464.847241:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c435284800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788664464.847253:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1875550140568704:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788664464.847271:0:19477:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788664464.847311:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664464.847316:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664464.847318:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664464.847322:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664464.847357:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664464.847360:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788664464.847362:0:8:0:(import.c:65:import_set_state_nolock()) ffff93c30256e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788664464.847366:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 555 00000100:00080000:1.0:1788664464.847369:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788664464.847373:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93c30256e800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788664464.847385:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c30480f480 x1875550140569344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788664464.847438:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140569216:0@lo:400:kworker.0 00000100:00100000:1.0:1788664464.847470:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664464.847492:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788664464.847498:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140568832:0@lo:400:kworker.0 00000100:00100000:3.0:1788664464.849207:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140569088:0@lo:400:kworker.0 00000100:00100000:3.0:1788664464.849488:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664464.849532:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140569728:0@lo:400:kworker.0 00000100:00100000:3.0:1788664464.849562:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664464.849621:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788664464.849628:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140568960:0@lo:400:kworker.0 00000100:00100000:3.0:1788664464.849652:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664464.849686:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140569088 00000100:00100000:2.0:1788664464.849694:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140569088 00000100:00100000:2.0:1788664464.849740:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788664464.849750:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140569088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664464.849843:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140569088:12345-0@lo:400:kworker.0 Request processed in 94us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664464.849850:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788664464.850082:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664464.850113:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140569472:0@lo:400:kworker.0 00000100:00100000:1.0:1788664464.850171:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140569344:0@lo:8:kworker.0 00000100:00100000:1.0:1788664464.850199:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664464.850230:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140569216 00000100:00100000:1.0:1788664464.850240:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140569216 00000100:00100000:1.0:1788664464.850277:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140569344 00000100:00100000:1.0:1788664464.850280:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140569344 00000100:00100000:1.0:1788664464.850296:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664464.850304:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140569216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664464.850343:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140569216:12345-0@lo:400:kworker.0 Request processed in 40us (2871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664464.850349:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664464.850362:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788664464.850366:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1875550140569344:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788664464.850412:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1875550140569344:12345-0@lo:8:kworker.0 Request processed in 43us (212us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788664464.850418:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788664464.850435:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664464.850462:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664464.850470:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c30256e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788664464.850474:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788664464.850478:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140569344:0@lo:8:kworker.0 00000020:01000004:1.0:1788664464.850718:0:19477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788664464.850731:0:19477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff93c30273cd40) 00000020:00000080:1.0:1788664464.850751:0:19477:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:2.0:1788664464.850892:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140568832 00000100:00100000:2.0:1788664464.850904:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140568832 00000100:00100000:2.0:1788664464.850929:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788664464.850935:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140568832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664464.850978:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140568832:12345-0@lo:400:kworker.0 Request processed in 44us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664464.850985:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:01000004:1.0:1788664464.851186:0:19477:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c3039b7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788664464.851190:0:19477:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c3039b7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788664464.851193:0:19477:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c3039b7800 3 00010000:00080000:1.0:1788664464.851220:0:19477:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c302648800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788664464.856123:0:19477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788664464.856338:0:19477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788664464.856387:0:19477:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788664464.856406:0:19477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xcd11f61c1413eb6f 00000100:00080000:1.0:1788664464.856416:0:19477:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788664464.856422:0:19477:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93c302648800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788664464.856453:0:19477:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c42266ad80 x1875550140569856/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788664464.856493:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1875550140569856:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788664464.856804:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140569600:0@lo:400:kworker.0 00000100:00100000:3.0:1788664464.856871:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788664464.857079:0:19477:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788664464.857102:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664464.857107:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664464.857110:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664464.857113:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788664464.858973:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140569728 00000100:00100000:0.0:1788664464.858986:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140569728 00000100:00100000:0.0:1788664464.859014:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140568960 00000100:00100000:0.0:1788664464.859017:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140568960 00000100:00100000:0.0:1788664464.859071:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788664464.859082:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140568960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664464.859164:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140568960:12345-0@lo:400:kworker.0 Request processed in 84us (9510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664464.859171:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788664464.859211:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788664464.859238:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788664464.859246:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140569728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664464.859278:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140569728:12345-0@lo:400:kworker.0 Request processed in 34us (9715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664464.859284:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000040:00080000:1.0:1788664464.861092:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788664464.862092:0:19464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788664464.862128:0:19464:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788664464.862147:0:19464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413eb45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eb4c expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664464.862158:0:19464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c4029e2800/0xcd11f61c1413eb45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413eb4c expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788664464.862211:0:19464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788664464.862213:0:19464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788664464.862214:0:19464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664464.862215:0:19464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664464.862216:0:19464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664464.862218:0:19464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664464.862219:0:19464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788664464.862221:0:19464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664464.862222:0:19464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788664464.862226:0:19464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788664464.862229:0:19464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788664464.862230:0:19464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788664464.862231:0:19464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664464.862232:0:19464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664464.862233:0:19464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664464.862234:0:19464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664464.862235:0:19464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788664464.862237:0:19464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664464.862238:0:19464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788664464.862262:0:19464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788664464.862288:0:19464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140569984:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788664464.862352:0:19464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664464.862393:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140569984 00000100:00100000:2.0:1788664464.862400:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140569984 00000100:00100000:2.0:1788664464.862441:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788664464.862450:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:19464:x1875550140569984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788664464.862475:0:17138:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788664464.862487:0:17138:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788664464.862615:0:19464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c412d91600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664464.863030:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140569088:0@lo:400:kworker.0 00010000:00080000:3.0:1788664464.863047:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c30480f800 x1875550140569728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664464.863056:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140569728:0@lo:400:kworker.0 00010000:00080000:3.0:1788664464.863081:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c30480d500 x1875550140568960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664464.863089:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140568960:0@lo:400:kworker.0 00000100:00100000:1.0:1788664464.863186:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664464.863232:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140569600 00000100:00100000:1.0:1788664464.863237:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140569600 00000100:00100000:1.0:1788664464.863271:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140569856 00000100:00100000:1.0:1788664464.863275:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140569856 00000100:00100000:1.0:1788664464.863290:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788664464.863298:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140569600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664464.863348:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875550140569600:12345-0@lo:400:kworker.0 Request processed in 50us (6477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664464.863355:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788664464.863370:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788664464.863374:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1875550140569856:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788664464.863397:0:18960:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:1.0:1788664464.863438:0:18960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xcd11f61c1413eb76 00000004:00100000:1.0:1788664464.863452:0:18960:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788664464.863479:0:18960:0:(import.c:65:import_set_state_nolock()) ffff93c30264e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664464.863530:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875550140569856:12345-0@lo:38:llog_process_th.0 Request processed in 154us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664464.863536:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788664464.863552:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788664464.863574:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c42266ad80 x1875550140569856/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664464.863582:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664464.863589:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788664464.863597:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788664464.863602:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788664464.863604:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c302648800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788664464.863610:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1875550140569856:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788664464.863637:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c30480c700 x1875550140569600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664464.863646:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1875550140569600:0@lo:400:kworker.0 00000100:00100000:2.0:1788664464.863943:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788664464.863982:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c30480df80 x1875550140569216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664464.863992:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140569216:0@lo:400:kworker.0 00000100:00100000:2.0:1788664464.864010:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140568832:0@lo:400:kworker.0 00000100:00100000:1.0:1788664464.864075:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140569472 00000100:00100000:1.0:1788664464.864079:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140569472 00000100:00100000:1.0:1788664464.864185:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788664464.864193:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140569472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664464.864236:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140569472:12345-0@lo:400:kworker.0 Request processed in 45us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664464.864243:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788664464.864419:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c30480e680 x1875550140569472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664464.864429:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140569472:0@lo:400:kworker.0 20000000:01000000:2.0:1788664464.869713:0:17138:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788664464.869733:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788664464.870100:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:19464:x1875550140569984:12345-0@lo:253:mount.lustre.0 Request processed in 7647us (7743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664464.870112:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788664464.870178:0:19464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:19464:1875550140569984:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788664464.870193:0:19464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788664464.870196:0:19464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788664464.870198:0:19464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788664464.870199:0:19464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664464.870200:0:19464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664464.870202:0:19464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664464.870203:0:19464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664464.870205:0:19464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788664464.870206:0:19464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664464.870217:0:19464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788664464.870232:0:19464:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788664464.870974:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788664464.870980:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788664464.871002:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c40502ba00/0xcd11f61c1413eb7d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664464.871016:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eaf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413eaea expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664464.871024:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4029e2c00/0xcd11f61c1413eaff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413eaf8 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664464.871031:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c40502ba00/0xcd11f61c1413eb7d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664464.871065:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4029e2c00/0xcd11f61c1413eaff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413eaf8 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664464.871079:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c4029e2c00/0xcd11f61c1413eaff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413eaf8 expref: 23 pid: 17138 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664464.871105:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875550140570112:0@lo:104: 00000100:00100000:3.0:1788664464.871146:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664464.871190:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eaf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413eaea expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664464.871199:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eaf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413eaea expref: 23 pid: 17136 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664464.871208:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875550140570240:0@lo:104: 00000100:00100000:3.0:1788664464.871228:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664464.871243:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4186e49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664464.871375:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140570112 00000100:00100000:0.0:1788664464.871382:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140570112 00000100:00100000:0.0:1788664464.871409:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140570240 00000100:00100000:0.0:1788664464.871412:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140570240 00000100:00100000:0.0:1788664464.871424:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788664464.871432:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+4:17159:x1875550140570112:12345-0@lo:104: 00010000:00010000:0.0:1788664464.871445:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413eaf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413eaff expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664464.871524:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788664464.871531:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+4:17159:x1875550140570112:12345-0@lo:104: Request processed in 99us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664464.871538:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788664464.871553:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788664464.871559:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+3:17159:x1875550140570240:12345-0@lo:104: 00010000:00010000:0.0:1788664464.871566:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413eaea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413eaf1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664464.871602:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788664464.871607:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+3:17159:x1875550140570240:12345-0@lo:104: Request processed in 49us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664464.871613:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788664464.871629:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664464.871635:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413eaf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413eaff expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664464.871641:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e3600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664464.871645:0:17131:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413eaf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413eaff expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664464.871653:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413eaf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413eaff expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664464.871660:0:17131:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413eaf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413eaff expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664464.871666:0:17131:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664464.871702:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413eaf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413eaff expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664464.871709:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664464.871730:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413eaf8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413eaff expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664464.871737:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4029e3600/0xcd11f61c1413eaf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413eaff expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664464.871752:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664464.871865:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664464.871952:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140570368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788664464.871984:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664464.872028:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140570368 00000100:00100000:1.0:1788664464.872032:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140570368 00010000:00010000:1.0:1788664464.872049:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4029e2c00/0xcd11f61c1413eaff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413eaf8 expref: 24 pid: 17138 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664464.872071:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788664464.872077:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:3636:x1875550140570368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788664464.872087:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664464.872092:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4029e2c00/0xcd11f61c1413eaff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413eaf8 expref: 24 pid: 17138 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.872101:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4029e2c00/0xcd11f61c1413eaff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413eaf8 expref: 24 pid: 17138 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.872116:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664464.872143:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:3636:x1875550140570368:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664464.872149:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788664464.872184:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140570368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664464.874145:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413eaea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413eaf1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664464.874156:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2a00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664464.874159:0:17131:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413eaea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413eaf1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664464.874168:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413eaea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413eaf1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664464.874176:0:17131:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413eaea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413eaf1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664464.874182:0:17131:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664464.874215:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413eaea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413eaf1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664464.874221:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664464.874244:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413eaea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413eaf1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664464.874264:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c4029e2a00/0xcd11f61c1413eaea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413eaf1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664464.874279:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664464.874281:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664464.874283:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664464.874311:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3637:1875550140570496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664464.874362:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664464.875046:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e2c00/0xcd11f61c1413eaff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413eaf8 expref: 23 pid: 17138 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664464.875058:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875550140570112:0@lo:104: 00000100:00100000:3.0:1788664464.875068:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875550140570240:0@lo:104: 00010000:00010000:3.0:1788664464.875088:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c40502ba00/0xcd11f61c1413eb7d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664464.876724:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140570496 00000100:00100000:1.0:1788664464.876736:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140570496 00010000:00010000:1.0:1788664464.876800:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eaf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413eaea expref: 23 pid: 17136 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664464.876848:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788664464.876858:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:3637:x1875550140570496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788664464.877000:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664464.877007:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eaf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413eaea expref: 23 pid: 17136 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.877019:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eaf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413eaea expref: 23 pid: 17136 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.877036:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40502ae00/0xcd11f61c1413eaf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413eaea expref: 23 pid: 17136 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.877051:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c40502ba00/0xcd11f61c1413eb7d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.877060:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c40502ba00/0xcd11f61c1413eb7d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788664464.877075:0:17130:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007147744s 00010000:00010000:1.0:1788664464.877080:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c40502ba00/0xcd11f61c1413eb7d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.877087:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c40502ba00/0xcd11f61c1413eb7d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.877094:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c40502ba00/0xcd11f61c1413eb7d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.877100:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c40502ba00/0xcd11f61c1413eb7d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.877114:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ba00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664464.877118:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c40502ba00/0xcd11f61c1413eb7d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.877126:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c40502ba00/0xcd11f61c1413eb7d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.877142:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c40502ba00/0xcd11f61c1413eb7d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.877153:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664464.877221:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:3637:x1875550140570496:12345-0@lo:103:ldlm_bl.0 Request processed in 364us (2858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664464.877228:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788664464.877269:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3637:1875550140570496:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788664464.877292:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c40502ba00/0xcd11f61c1413eb7d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.877301:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c40502ba00/0xcd11f61c1413eb7d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664464.877307:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40502ba00/0xcd11f61c1413eb7d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788664464.892420:0:19464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788664464.899652:0:19464:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788664464.899665:0:19464:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788664464.899703:0:19464:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788664464.899751:0:19464:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788664464.900136:0:19464:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788664464.900154:0:19464:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788664464.904741:0:19464:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788664464.905019:0:19464:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788664465.093522:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664465.471841:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140570624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664465.471910:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.472079:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140570624 00000100:00100000:2.0:1788664465.472088:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140570624 00000100:00100000:2.0:1788664465.472133:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664465.472142:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140570624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788664465.472170:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788664465.472217:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140570624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664465.472224:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788664465.472262:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303a6d500 x1875550140570624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664465.472281:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140570624:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1788664465.846061:0:19530:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788664465.846720:0:19530:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788664465.918829:0:3635:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664445/real 1788664445] req@ffff93c4350ffb80 x1875550140558208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664465 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664465.918858:0:3635:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c4350ffb80 x1875550140558208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664465 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664465.918868:0:3635:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664445/real 1788664445] req@ffff93c4350fd880 x1875550140558336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664465 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664465.918880:0:3635:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c4350fd880 x1875550140558336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664465 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788664465.918897:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c40641c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664465.918907:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788664465.918911:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140558208:0@lo:8:kworker.0 00000100:00080000:2.0:1788664465.918917:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c408214800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664465.918946:0:3635:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788664465.918949:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140558336:0@lo:8:kworker.0 00000100:00080000:2.0:1788664465.920118:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788664465.920123:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788664465.920126:0:8:0:(import.c:65:import_set_state_nolock()) ffff93c40641c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664465.920132:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 540 00000100:00080000:2.0:1788664465.920137:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788664465.920143:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93c40641c800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664465.920162:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039c8e00 x1875550140571008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788664465.920176:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788664465.920179:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788664465.920181:0:8:0:(import.c:65:import_set_state_nolock()) ffff93c408214800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664465.920184:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 540 00000100:00080000:2.0:1788664465.920186:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788664465.920190:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c408214800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664465.920199:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c3039ca300 x1875550140571136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788664465.920227:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788664465.920230:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788664465.920231:0:8:0:(import.c:65:import_set_state_nolock()) ffff93c30256e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664465.920236:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93c30256e800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788664465.920244:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c303abd500 x1875550140571648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664465.920313:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140571392:0@lo:400:kworker.0 00000100:00100000:0.0:1788664465.920313:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3639:1875550140570752:0@lo:400:kworker.0 00000100:00100000:2.0:1788664465.920444:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.920475:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140572032:0@lo:400:kworker.0 00000100:00100000:2.0:1788664465.920512:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.920544:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140570880:0@lo:400:kworker.0 00000100:00100000:2.0:1788664465.920568:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.920585:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140571776:0@lo:400:kworker.0 00000100:00100000:2.0:1788664465.920606:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.920622:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140572288:0@lo:400:kworker.0 00000100:00100000:2.0:1788664465.920646:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.920664:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788664465.920670:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140571264:0@lo:400:kworker.0 00000100:00100000:2.0:1788664465.920693:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.920711:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140571904:0@lo:400:kworker.0 00000100:00100000:2.0:1788664465.920734:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.920761:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140571392 00000100:00100000:2.0:1788664465.920767:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140571392 00000100:00100000:2.0:1788664465.920820:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140570880 00000100:00100000:2.0:1788664465.920823:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140570880 00000100:00100000:2.0:1788664465.920839:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788664465.920846:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140571392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664465.920897:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140571392:12345-0@lo:400:kworker.0 Request processed in 51us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664465.920903:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788664465.921089:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140572032 00000100:00100000:1.0:1788664465.921093:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140572032 00000100:00100000:1.0:1788664465.921116:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140571776 00000100:00100000:1.0:1788664465.921118:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140571776 00000100:00100000:1.0:1788664465.921139:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140572288 00000100:00100000:1.0:1788664465.921142:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140572288 00000100:00100000:1.0:1788664465.921162:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140571264 00000100:00100000:1.0:1788664465.921164:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140571264 00000100:00100000:1.0:1788664465.921171:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140571904 00000100:00100000:1.0:1788664465.921173:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140571904 00000100:00100000:1.0:1788664465.921184:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788664465.921191:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140572032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664465.921222:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875550140572032:12345-0@lo:400:kworker.0 Request processed in 33us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664465.921227:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788664465.921238:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788664465.921243:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140571776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664465.921269:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875550140571776:12345-0@lo:400:kworker.0 Request processed in 25us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664465.921274:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788664465.921284:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788664465.921291:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140572288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664465.921314:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875550140572288:12345-0@lo:400:kworker.0 Request processed in 24us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664465.921319:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788664465.921328:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788664465.921333:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140571264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664465.921358:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875550140571264:12345-0@lo:400:kworker.0 Request processed in 25us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664465.921362:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788664465.921371:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788664465.921384:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140571904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664465.921412:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140571904:12345-0@lo:400:kworker.0 Request processed in 28us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664465.921417:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788664465.921433:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664465.921535:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788664465.921546:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140570880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664465.921576:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140570880:12345-0@lo:400:kworker.0 Request processed in 34us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664465.921582:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788664465.921704:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140571008:0@lo:8:kworker.0 00000100:00100000:2.0:1788664465.921733:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.921791:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140571136:0@lo:8:kworker.0 00000100:00100000:2.0:1788664465.921811:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.921827:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140571648:0@lo:8:kworker.0 00000100:00100000:2.0:1788664465.921849:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.921878:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140571008 00000100:00100000:2.0:1788664465.921882:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140571008 00000100:00100000:2.0:1788664465.921900:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140571136 00000100:00100000:2.0:1788664465.921903:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140571136 00000100:00100000:2.0:1788664465.921909:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140571648 00000100:00100000:2.0:1788664465.921911:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140571648 00000100:00100000:2.0:1788664465.921920:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788664465.921924:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3635:x1875550140571008:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788664465.923977:0:18649:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:2.0:1788664465.924008:0:18649:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd11f61c1413eb84 00002000:00100000:2.0:1788664465.924023:0:18649:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93c30256b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788664465.924028:0:18649:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788664465.924030:0:18649:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788664465.924184:0:18649:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788664465.924209:0:18649:0:(import.c:65:import_set_state_nolock()) ffff93c30256c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664465.924290:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1875550140571008:12345-0@lo:8:kworker.0 Request processed in 2363us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664465.924308:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788664465.924333:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788664465.924339:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3635:x1875550140571136:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788664465.924357:0:18649:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:2.0:1788664465.924373:0:18649:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd11f61c1413eb8b 00002000:00100000:2.0:1788664465.924379:0:18649:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93c30256d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788664465.924382:0:18649:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788664465.924384:0:18649:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788664465.924514:0:18649:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788664465.924528:0:18649:0:(import.c:65:import_set_state_nolock()) ffff93c3039b0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664465.924559:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1875550140571136:12345-0@lo:8:kworker.0 Request processed in 219us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664465.924565:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788664465.924578:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788664465.924583:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3635:x1875550140571648:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788664465.924597:0:18649:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:2.0:1788664465.924613:0:18649:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd11f61c1413eb92 00002000:00100000:2.0:1788664465.924619:0:18649:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff93c40713c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788664465.924622:0:18649:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788664465.924624:0:18649:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788664465.924644:0:18649:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788664465.924655:0:18649:0:(import.c:65:import_set_state_nolock()) ffff93c407139800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664465.924684:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3635:x1875550140571648:12345-0@lo:8:kworker.0 Request processed in 100us (2834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664465.924691:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788664465.924750:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039c8e00 x1875550140571008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788664490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664465.924762:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788664465.924787:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788664465.924795:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788664465.924800:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788664465.924802:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c40641c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788664465.924826:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788664465.924832:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140571008:0@lo:8:kworker.0 00010000:00080000:2.0:1788664465.924845:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039ca300 x1875550140571136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788664490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664465.924853:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788664465.924857:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788664465.924861:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788664465.924863:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788664465.924865:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c408214800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788664465.924875:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788664465.924879:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1875550140571136:0@lo:8:kworker.0 00010000:00080000:2.0:1788664465.924889:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abd500 x1875550140571648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788664490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788664465.924898:0:3635:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788664465.924902:0:3635:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788664465.924905:0:3635:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788664465.924907:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93c30256e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788664465.924919:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788664465.924922:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1875550140571648:0@lo:8:kworker.0 00000004:00080000:2.0:1788664465.924984:0:17170:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1788664465.925005:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1875550140572544:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788664465.925037:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.925059:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406b8ca80 going to sleep for 11 seconds 00000004:00080000:3.0:1788664465.925348:0:17167:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788664465.925412:0:17167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 561062640387ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788664465.925419:0:17167:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788664465.925440:0:17169:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788664465.925470:0:17169:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 561062698127ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788664465.925474:0:17169:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788664465.926104:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140572544 00000100:00100000:1.0:1788664465.926112:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140572544 00000100:00100000:1.0:1788664465.926164:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788664465.926173:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17170:x1875550140572544:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788664465.926365:0:17887:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788664465.926383:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1875550140572800:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788664465.926424:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664465.926446:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403067000 going to sleep for 11 seconds 00000100:00100000:1.0:1788664465.926461:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140572800 00000100:00100000:1.0:1788664465.926464:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140572800 00000100:00100000:1.0:1788664465.926483:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788664465.926490:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17887:x1875550140572800:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:1.0:1788664465.926533:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664465.926673:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140572416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664465.926711:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.926748:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140572416 00000100:00100000:2.0:1788664465.926752:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140572416 00000100:00100000:2.0:1788664465.926810:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664465.926818:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303aba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875550140572416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664465.926838:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788664465.926884:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303aba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875550140572416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664465.926890:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788664465.928038:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abd500 x1875550140572416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664465.928133:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.928237:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140572416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664465.928273:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140572672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664465.928310:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.928342:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140571392:0@lo:400:kworker.0 00010000:00080000:2.0:1788664465.928357:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abdc00 x1875550140572032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788664465.928364:0:17168:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788664465.928370:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1875550140572032:0@lo:400:kworker.0 00000100:00100000:2.0:1788664465.928387:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664465.928403:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140572928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664465.928427:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664465.928449:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140572672 00000100:00100000:2.0:1788664465.928455:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140572672 00000100:00100000:0.0:1788664465.928456:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303add880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1875550140573056:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788664465.928482:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140572928 00000100:00100000:2.0:1788664465.928485:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140572928 00000100:00100000:2.0:1788664465.928529:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664465.928537:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1875550140572672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788664465.928551:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788664465.928588:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1875550140572672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664465.928594:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664465.928609:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788664465.928615:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875550140572928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664465.928627:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788664465.928633:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664465.928656:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3010866c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664465.928662:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875550140572928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664465.928668:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1788664465.928673:0:17886:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:2.0:1788664465.928701:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039caa00 x1875550140571264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664465.928713:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875550140571264:0@lo:400:kworker.0 00010000:00080000:2.0:1788664465.928725:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abca80 x1875550140571904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664465.928734:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140571904:0@lo:400:kworker.0 00000100:00100000:2.0:1788664465.928744:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140570880:0@lo:400:kworker.0 00000004:00080000:0.0:1788664465.928758:0:17886:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 561065985367ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788664465.928766:0:17886:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:2.0:1788664465.928792:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abd880 x1875550140571776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664465.928802:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875550140571776:0@lo:400:kworker.0 00010000:00080000:2.0:1788664465.928817:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abc700 x1875550140572288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664465.928825:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1875550140572288:0@lo:400:kworker.0 00010000:00080000:2.0:1788664465.928855:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303adc700 x1875550140572928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664465.928867:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140572928:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788664465.928875:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42266bb80 x1875550140572672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664465.928885:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140572672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664465.928907:0:18649:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788664465.928914:0:18649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788664465.930474:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140570752 00000100:00100000:0.0:1788664465.930494:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140570752 00000100:00100000:1.0:1788664465.930670:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788664465.930682:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140573056 00000100:00100000:1.0:1788664465.930686:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140573056 00000100:00080000:1.0:1788664465.930714:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788664465.934444:0:18648:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788664465.934458:0:18648:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788664465.934466:0:18648:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000004:00080000:3.0:1788664465.937183:0:17123:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788664465.937200:0:17123:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788664465.939452:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788664465.939473:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:3639:x1875550140570752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664465.939749:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:3639:x1875550140570752:12345-0@lo:400:kworker.0 Request processed in 285us (11617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664465.939768:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788664465.940020:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3639:1875550140570752:0@lo:400:kworker.0 00000100:00100000:0.0:1788664465.940032:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140571520:0@lo:400:kworker.0 00000100:00100000:0.0:1788664465.940065:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664465.940095:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140572160:0@lo:400:kworker.0 00000100:00100000:0.0:1788664465.940120:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664465.940144:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140572160 00000100:00100000:0.0:1788664465.940150:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140572160 00000100:00100000:0.0:1788664465.940212:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788664465.940219:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140572160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664465.940254:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140572160:12345-0@lo:400:kworker.0 Request processed in 35us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664465.940260:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788664465.940290:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abe300 x1875550140572160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664465.940303:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140572160:0@lo:400:kworker.0 00000100:00100000:2.0:1788664465.940314:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140571520 00000100:00100000:2.0:1788664465.940320:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140571520 00000100:00100000:2.0:1788664465.940346:0:18649:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788664465.940356:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664465.940363:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140571520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664465.940412:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140571520:12345-0@lo:400:kworker.0 Request processed in 49us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664465.940419:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664465.940492:0:19534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788664465.940508:0:19534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17168:x1875550140573056:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:0.0:1788664465.941673:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303abc380 x1875550140571520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664465.941688:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140571520:0@lo:400:kworker.0 00000100:00080000:2.0:1788664465.943822:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788664465.955219:0:17875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788664465.956808:0:19534:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788664465.956817:0:19534:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788664465.956823:0:19534:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:1.0:1788664465.957000:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664465.957011:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413eb99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.957035:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664465.957040:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664465.957046:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413eb99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788664465.957618:0:19229:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788664465.957625:0:19229:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788664465.957719:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17887:x1875550140572800:12345-0@lo:7:osp-pre-1-1.0 Request processed in 31225us (31290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664465.957730:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788664465.957768:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413eb99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.957803:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413eb99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.957811:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413eb99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664465.957859:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1875550140572800:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788664465.957875:0:17887:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788664465.957912:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1875550140573184:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788664465.957950:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664465.957985:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403067000 going to sleep for 11 seconds 00010000:00010000:1.0:1788664465.958009:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664465.958020:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664465.958027:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413eb99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.958035:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84600 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664465.958047:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413eb99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.958057:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413eb99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.958085:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413eb99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.958094:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413eb99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.958110:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.958112:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.958113:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664465.958276:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140573184 00000100:00100000:3.0:1788664465.958283:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140573184 00000100:00100000:3.0:1788664465.958340:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788664465.958350:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17887:x1875550140573184:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788664465.958374:0:18649:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788664465.958420:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17887:x1875550140573184:12345-0@lo:5:osp-pre-1-1.0 Request processed in 73us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664465.958427:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788664465.959281:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1875550140573184:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788664465.959294:0:17887:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788664465.959328:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1875550140573312:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788664465.959804:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664465.959831:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c403067000 going to sleep for 11 seconds 00002000:00010000:1.0:1788664465.959918:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664465.959926:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d2e46f/0xcd11f61c1413eba0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.959940:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664465.959944:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664465.959955:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d2e46f/0xcd11f61c1413eba0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.959969:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9d2e46f/0xcd11f61c1413eba0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.959979:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d2e46f/0xcd11f61c1413eba0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.959987:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d2e46f/0xcd11f61c1413eba0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.960004:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664465.960016:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788664465.960018:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140573312 00010000:00010000:1.0:1788664465.960021:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9d2e46f/0xcd11f61c1413eba0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664465.960026:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140573312 00010000:00010000:1.0:1788664465.960032:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85c00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664465.960037:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d2e46f/0xcd11f61c1413eba0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.960045:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d2e46f/0xcd11f61c1413eba0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.960059:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9d2e46f/0xcd11f61c1413eba0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664465.960067:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788664465.960076:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17887:x1875550140573312:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788664465.960109:0:19229:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00010000:1.0:1788664465.961176:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9d2e46f/0xcd11f61c1413eba0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.961194:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.961196:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.961198:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664465.962555:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664465.962566:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413eba7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.962581:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664465.962585:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664465.962591:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413eba7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.962604:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413eba7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.962613:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413eba7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.962620:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413eba7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.962640:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664465.962652:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664465.962664:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413eba7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.962671:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84400 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664465.962676:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413eba7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.962686:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413eba7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.962702:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413eba7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.962710:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413eba7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.962727:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.962729:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.962730:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664465.963740:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664465.963751:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ebae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.963763:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664465.963766:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664465.963791:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ebae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.963818:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ebae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.963828:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ebae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.963836:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ebae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.963855:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664465.964006:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664465.964012:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ebae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.964020:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85800 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664465.964024:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ebae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.964032:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ebae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.964046:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ebae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.964054:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ebae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.964154:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.964157:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.964158:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664465.965835:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664465.965846:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413ebb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.965861:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664465.965865:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664465.965872:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413ebb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.965883:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413ebb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.965892:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413ebb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.965899:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413ebb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.965937:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664465.965987:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664465.965995:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413ebb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.966012:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84200 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664465.966017:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413ebb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.966026:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413ebb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.966044:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413ebb5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.966052:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026b07c2d/0xcd11f61c1413ebb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.966071:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.966073:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.966074:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664465.968650:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664465.968662:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003894d6f0/0xcd11f61c1413ebbc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.968692:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664465.968697:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664465.968703:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003894d6f0/0xcd11f61c1413ebbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.968719:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003894d6f0/0xcd11f61c1413ebbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.968729:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003894d6f0/0xcd11f61c1413ebbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.968736:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003894d6f0/0xcd11f61c1413ebbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.968764:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664465.968995:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664465.969004:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003894d6f0/0xcd11f61c1413ebbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.969014:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85600 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664465.969019:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003894d6f0/0xcd11f61c1413ebbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.969030:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003894d6f0/0xcd11f61c1413ebbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.969054:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003894d6f0/0xcd11f61c1413ebbc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.969062:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003894d6f0/0xcd11f61c1413ebbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.969082:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.969085:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.969086:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788664465.970802:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788664465.970812:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ebc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.970826:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1788664465.970831:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664465.970837:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ebc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.970849:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ebc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.970859:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ebc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.970866:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ebc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.970906:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664465.971095:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664465.971103:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ebc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.971112:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a600 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664465.971116:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ebc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.971126:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ebc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.971154:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ebc3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.971162:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ebc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.971184:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.971187:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.971190:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788664465.974187:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664465.974205:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ebca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.974221:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664465.974226:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664465.974232:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ebca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.974249:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ebca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.974260:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ebca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.974267:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ebca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.974282:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664465.974697:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664465.974704:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ebca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.974712:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957200 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664465.974716:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ebca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.974725:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ebca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.974742:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ebca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.974748:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ebca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788664465.974862:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664465.974868:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ebd1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.974876:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664465.974879:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664465.974883:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ebd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.974892:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ebd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.974906:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ebd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.974913:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ebd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.974933:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788664465.975450:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788664465.975458:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b36e2d48/0xcd11f61c1413ebd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664465.975467:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=561s v=(0 0) 00010000:00010000:2.0:1788664465.975470:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664465.975474:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b36e2d48/0xcd11f61c1413ebd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664465.975486:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b36e2d48/0xcd11f61c1413ebd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664465.975492:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b36e2d48/0xcd11f61c1413ebd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664465.975511:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b36e2d48/0xcd11f61c1413ebd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664465.975520:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788664465.975565:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:0.0:1788664465.976328:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664465.976336:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ebdf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.976346:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664465.976350:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664465.976354:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ebdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.976396:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ebdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.976412:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ebdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.976419:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ebdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.976447:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788664465.976740:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788664465.976745:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b36e2d48/0xcd11f61c1413ebd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.976758:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2c00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664465.976762:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b36e2d48/0xcd11f61c1413ebd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.976797:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b36e2d48/0xcd11f61c1413ebd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.976811:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b36e2d48/0xcd11f61c1413ebd8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.976818:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b36e2d48/0xcd11f61c1413ebd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.976832:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664465.976836:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ebdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.976843:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664465.976846:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ebdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.976854:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ebdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.976864:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ebdf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.976871:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ebdf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.976894:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.976896:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.976898:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664465.978301:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664465.978312:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008cdf99b/0xcd11f61c1413ebe6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.978325:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664465.978340:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664465.978347:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008cdf99b/0xcd11f61c1413ebe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.978371:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008cdf99b/0xcd11f61c1413ebe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.978382:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008cdf99b/0xcd11f61c1413ebe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.978390:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008cdf99b/0xcd11f61c1413ebe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.978419:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788664465.978560:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664465.978567:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008cdf99b/0xcd11f61c1413ebe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.978575:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400031800 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664465.978579:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008cdf99b/0xcd11f61c1413ebe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.978589:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008cdf99b/0xcd11f61c1413ebe6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.978602:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008cdf99b/0xcd11f61c1413ebe6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.978609:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008cdf99b/0xcd11f61c1413ebe6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.978625:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664465.978627:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664465.978629:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788664465.979317:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788664465.979326:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ebed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.979336:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1788664465.979341:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664465.979346:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ebed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.979357:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ebed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.979366:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ebed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.979373:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ebed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.979385:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664465.979563:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664465.979569:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ebed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.979588:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502aa00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664465.979592:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ebed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.979600:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ebed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.979613:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ebed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.979621:0:19537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ebed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.979639:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.979641:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.979642:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.979915:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ebd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.979925:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956200 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664465.979929:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ebd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.979938:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ebd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.979951:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ebd1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.979957:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ebd1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.979971:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.979973:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.979974:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664465.980021:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664465.980027:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ebf4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980036:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664465.980045:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664465.980050:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ebf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980060:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ebf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980069:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ebf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980077:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ebf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980089:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788664465.980487:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664465.980494:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ebfb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980512:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664465.980515:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664465.980519:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ebfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980528:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ebfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980535:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ebfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980548:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ebfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980562:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788664465.980570:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788664465.980574:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ebf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980580:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400031400 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664465.980583:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ebf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980589:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ebf4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980599:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ebf4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980606:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ebf4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980619:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664465.980623:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ebfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980642:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030c00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664465.980646:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ebfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980653:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ebfb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980664:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ebfb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980670:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ebfb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.980682:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.980683:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.980685:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664465.980857:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788664465.981331:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664465.981338:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413ec02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.981359:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664465.981362:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664465.981365:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413ec02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.981373:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413ec02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.981380:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413ec02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.981386:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413ec02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.981404:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664465.981607:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664465.981613:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413ec02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.981621:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957e00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664465.981624:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413ec02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.981632:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413ec02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.981652:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413ec02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.981659:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413ec02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.981674:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.981675:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.981677:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788664465.981919:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788664465.981926:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f097361/0xcd11f61c1413ec09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.981935:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1788664465.981938:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664465.981942:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f097361/0xcd11f61c1413ec09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.981952:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f097361/0xcd11f61c1413ec09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.981966:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f097361/0xcd11f61c1413ec09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.981973:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f097361/0xcd11f61c1413ec09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.981988:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788664465.983374:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140573440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664465.983450:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664465.983488:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664465.983494:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140573568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664465.983527:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664465.983562:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140573440 00000100:00100000:1.0:1788664465.983570:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140573440 00000100:00100000:1.0:1788664465.983608:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140573568 00000100:00100000:1.0:1788664465.983611:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140573568 00000100:00100000:1.0:1788664465.983626:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788664465.983633:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140573440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788664465.983668:0:17883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788664465.983714:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140573440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664465.983722:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788664465.983736:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788664465.983741:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140573568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664465.983791:0:17883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788664465.983820:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140573568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664465.983826:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788664465.983871:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140573568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664465.983883:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140573440:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788664465.984019:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664465.984027:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f097361/0xcd11f61c1413ec09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.984040:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502b400 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664465.984044:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f097361/0xcd11f61c1413ec09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.984053:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f097361/0xcd11f61c1413ec09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.984207:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.984323:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f097361/0xcd11f61c1413ec09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.984332:0:19537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f097361/0xcd11f61c1413ec09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.984352:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.984360:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.984362:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664465.984566:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664465.984573:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038fa4207/0xcd11f61c1413ec10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.984584:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664465.984587:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664465.984593:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038fa4207/0xcd11f61c1413ec10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.984604:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038fa4207/0xcd11f61c1413ec10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.984612:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038fa4207/0xcd11f61c1413ec10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.984620:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038fa4207/0xcd11f61c1413ec10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.984670:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788664465.985805:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788664465.985814:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413ec17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.985826:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1788664465.985829:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664465.985834:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413ec17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.985844:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413ec17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.985852:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413ec17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.985860:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413ec17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664465.987247:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664465.987258:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ec1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.987270:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664465.987274:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664465.987279:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ec1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.987290:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ec1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.987298:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ec1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.987306:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ec1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.991864:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788664465.991880:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038fa4207/0xcd11f61c1413ec10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.991894:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400031600 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664465.991899:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038fa4207/0xcd11f61c1413ec10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.991910:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038fa4207/0xcd11f61c1413ec10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.991956:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038fa4207/0xcd11f61c1413ec10 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.991964:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038fa4207/0xcd11f61c1413ec10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.993231:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664465.993243:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413ec17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.993254:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ba00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664465.993259:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413ec17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.993269:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.993289:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413ec17 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.993298:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664465.993302:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ec1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.993308:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400031a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664465.993322:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ec1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.993330:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ec1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.993341:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ec1e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.993349:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664465.993351:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664465.993353:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.993435:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788664465.993443:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000530915d3/0xcd11f61c1413ec17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.993824:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788664465.994037:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788664465.994045:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ec25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.994137:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1788664465.994141:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664465.994147:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ec25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.994161:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ec25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.994171:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ec25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.994179:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ec25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.994201:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788664465.994360:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664465.994365:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ec25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.994373:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502aa00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664465.994378:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ec25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.994386:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ec25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.994400:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ec25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.994406:0:19537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000438f1872/0xcd11f61c1413ec25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664465.994429:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664465.994431:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664465.994432:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788664465.994579:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788664465.994586:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413ec2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.994594:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1788664465.994598:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664465.994602:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413ec2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.994610:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413ec2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.994628:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413ec2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.994635:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413ec2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.994682:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788664465.995335:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788664465.995342:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413ec33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995353:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1788664465.995356:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664465.995361:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413ec33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995370:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413ec33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995378:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413ec33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995386:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413ec33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995412:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788664465.995421:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788664465.995425:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413ec2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995433:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ae00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664465.995437:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413ec2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995446:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413ec2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995458:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413ec2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995464:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004667bdb3/0xcd11f61c1413ec2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995477:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664465.995480:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413ec33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995486:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a400 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664465.995490:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413ec33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995519:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413ec33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995529:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413ec33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995535:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aded206/0xcd11f61c1413ec33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995546:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.995547:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.995549:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788664465.995869:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788664465.995875:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ec3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995882:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1788664465.995885:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664465.995889:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ec3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995898:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ec3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995906:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ec3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995918:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ec3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.995945:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788664465.996343:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788664465.996349:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ec41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.996358:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1788664465.996362:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664465.996365:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ec41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.996374:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ec41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.996381:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ec41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.996387:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ec41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.996402:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788664465.996411:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788664465.996415:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ec3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.996429:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502a600 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664465.996432:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ec3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.996441:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ec3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.996454:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ec3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.996461:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0e8d75b/0xcd11f61c1413ec3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.996474:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664465.996477:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ec41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.996483:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85800 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664465.996486:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ec41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.996493:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ec41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.996513:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ec41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.996526:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2f06d0/0xcd11f61c1413ec41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.996538:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.996540:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.996542:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664465.996886:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788664465.996893:0:19534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ec1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.999206:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788664465.999293:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788664465.999302:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413ec48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.999315:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1788664465.999319:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664465.999325:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413ec48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.999338:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413ec48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.999347:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413ec48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.999354:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413ec48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.999370:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664465.999386:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664465.999391:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413ec48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.999398:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84400 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664465.999402:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413ec48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.999411:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413ec48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.999425:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413ec48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.999432:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f1a9775/0xcd11f61c1413ec48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664465.999444:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.999446:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.999447:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664465.999858:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664465.999866:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ec4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.999874:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664465.999883:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664465.999888:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ec4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.999897:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ec4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.999905:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ec4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.999911:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ec4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664465.999921:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664466.001044:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664466.001052:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ec4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.001137:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030c00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664466.001142:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ec4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.001162:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ec4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.001179:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ec4f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.001186:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb29acd4/0xcd11f61c1413ec4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.001205:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664466.001207:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664466.001209:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664466.001390:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664466.001396:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000928560a5/0xcd11f61c1413ec56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.001406:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664466.001410:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664466.001415:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000928560a5/0xcd11f61c1413ec56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.001426:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000928560a5/0xcd11f61c1413ec56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.001433:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000928560a5/0xcd11f61c1413ec56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.001446:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000928560a5/0xcd11f61c1413ec56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.001458:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788664466.001647:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664466.001653:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000694f3a1f/0xcd11f61c1413ec5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.001661:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664466.001664:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664466.001668:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000694f3a1f/0xcd11f61c1413ec5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.001677:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000694f3a1f/0xcd11f61c1413ec5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.001685:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000694f3a1f/0xcd11f61c1413ec5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.001692:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000694f3a1f/0xcd11f61c1413ec5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.001700:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788664466.003555:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788664466.003567:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000928560a5/0xcd11f61c1413ec56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.003593:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400031400 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664466.003597:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000928560a5/0xcd11f61c1413ec56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.003608:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000928560a5/0xcd11f61c1413ec56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.003626:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000928560a5/0xcd11f61c1413ec56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.003634:0:19537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000928560a5/0xcd11f61c1413ec56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.003659:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664466.003663:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000694f3a1f/0xcd11f61c1413ec5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.003669:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030800 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664466.003672:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000694f3a1f/0xcd11f61c1413ec5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.003679:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000694f3a1f/0xcd11f61c1413ec5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.003689:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000694f3a1f/0xcd11f61c1413ec5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.003701:0:19537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000694f3a1f/0xcd11f61c1413ec5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.003714:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664466.003715:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664466.003717:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.003800:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664466.004350:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664466.004582:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664466.004591:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ec64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.004603:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664466.004607:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664466.004613:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ec64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.004624:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ec64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.004633:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ec64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.004640:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ec64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.004665:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788664466.004838:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664466.004844:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ec64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.004851:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030400 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664466.004855:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ec64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.004863:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ec64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.004874:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ec64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.004882:0:19537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ec64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.004896:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.004898:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.004900:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788664466.004996:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788664466.005002:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413ec6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.005011:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1788664466.005013:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664466.005017:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413ec6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.005026:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413ec6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.005033:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413ec6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.005045:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413ec6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.005073:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664466.005489:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664466.005510:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413ec6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.005519:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b85c00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664466.005522:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413ec6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.005529:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413ec6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.005541:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413ec6b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.005548:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9d2e46f/0xcd11f61c1413ec6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.005564:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664466.005566:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664466.005568:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788664466.007056:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1788664466.007177:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664466.007186:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ec79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.007210:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664466.007214:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664466.007220:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ec79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.007234:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ec79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.007244:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ec79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.007252:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ec79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.007290:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664466.007713:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413ec72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.007723:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1788664466.007727:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664466.007731:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413ec72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.007742:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413ec72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.007756:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413ec72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.007764:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413ec72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.007817:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664466.007822:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ec79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.007839:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664466.007843:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ec79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.007851:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ec79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.007864:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ec79 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.007870:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ec79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.007883:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664466.007885:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664466.007886:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664466.007912:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788664466.008045:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664466.008050:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413ec72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.008057:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84600 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664466.008071:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413ec72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.008080:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413ec72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.008103:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413ec72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.008109:0:19537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f6c6446/0xcd11f61c1413ec72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.008122:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.008124:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.008126:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788664466.009908:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664466.009918:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ec80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.009931:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664466.009935:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664466.009941:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ec80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.009955:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ec80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.009964:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ec80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.009971:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ec80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.010003:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664466.012335:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664466.012347:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ec80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.012358:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956e00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664466.012363:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ec80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.012386:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ec80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.012404:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ec80 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.012411:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ec80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.012430:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664466.012432:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664466.012433:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788664466.012997:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664466.013007:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000816ed874/0xcd11f61c1413ec87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.013019:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664466.013023:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664466.013029:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000816ed874/0xcd11f61c1413ec87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.013040:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000816ed874/0xcd11f61c1413ec87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.013049:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000816ed874/0xcd11f61c1413ec87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.013056:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000816ed874/0xcd11f61c1413ec87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.013089:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788664466.015761:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664466.015788:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ec8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.015805:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664466.015816:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664466.015823:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ec8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.015837:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ec8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.015846:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ec8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.015854:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ec8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.015871:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788664466.015979:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664466.015986:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000816ed874/0xcd11f61c1413ec87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.015994:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957e00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664466.015998:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000816ed874/0xcd11f61c1413ec87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.016006:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000816ed874/0xcd11f61c1413ec87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.016022:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000816ed874/0xcd11f61c1413ec87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.016043:0:19537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000816ed874/0xcd11f61c1413ec87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.016175:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664466.016180:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ec8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.016187:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956200 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664466.016191:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ec8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.016198:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ec8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.016209:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ec8e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.016216:0:19537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ec8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.016229:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.016230:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.016232:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664466.016576:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788664466.017283:0:19465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788664466.017314:0:19465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788664466.017318:0:19465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788664466.017486:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664466.017493:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ec95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.017525:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664466.017528:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664466.017534:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ec95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.017546:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ec95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.017556:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ec95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.017563:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ec95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.017585:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788664466.017752:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17887:x1875550140573312:12345-0@lo:5:osp-pre-1-1.0 Request processed in 57673us (58383us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788664466.017763:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664466.017889:0:17887:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788664466.017897:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1875550140573312:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788664466.017913:0:17887:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788664466.017965:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17887:1875550140573696:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788664466.017998:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664466.018022:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4123c1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788664466.018042:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140573696 00000100:00100000:0.0:1788664466.018047:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140573696 00000100:00100000:0.0:1788664466.018212:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788664466.018221:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17887:x1875550140573696:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788664466.018270:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17887:x1875550140573696:12345-0@lo:900:osp-pre-1-1.0 Request processed in 51us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664466.018277:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788664466.018306:0:17887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c4350fd880 x1875550140573696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788664482 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664466.018316:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17887:1875550140573696:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1788664466.018491:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664466.018509:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006037babc/0xcd11f61c1413ec9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.018521:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664466.018530:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664466.018535:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006037babc/0xcd11f61c1413ec9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.018548:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006037babc/0xcd11f61c1413ec9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.018557:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006037babc/0xcd11f61c1413ec9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.018565:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006037babc/0xcd11f61c1413ec9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.018581:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788664466.018734:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664466.018740:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ec95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.018755:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664466.018759:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ec95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.018785:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ec95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.018802:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ec95 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.018810:0:19537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ec95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.018825:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664466.018829:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006037babc/0xcd11f61c1413ec9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.018842:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400031a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664466.018845:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006037babc/0xcd11f61c1413ec9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.018854:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006037babc/0xcd11f61c1413ec9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.018865:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006037babc/0xcd11f61c1413ec9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.018872:0:19537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006037babc/0xcd11f61c1413ec9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.018886:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.018888:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.018890:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788664466.020005:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664466.020017:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413eca3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.020030:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664466.020034:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664466.020039:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413eca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.020051:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413eca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.020217:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413eca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.020225:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413eca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.020246:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788664466.020259:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664466.020265:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413eca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.020273:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957200 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664466.020277:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413eca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.020286:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413eca3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.020298:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413eca3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.020307:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413eca3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.020324:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.020330:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.020332:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664466.020731:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664466.020739:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025d55974/0xcd11f61c1413ecaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.020760:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664466.020763:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664466.020767:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025d55974/0xcd11f61c1413ecaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.020792:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025d55974/0xcd11f61c1413ecaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.020800:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025d55974/0xcd11f61c1413ecaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.020814:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025d55974/0xcd11f61c1413ecaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.020832:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664466.021150:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664466.021157:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025d55974/0xcd11f61c1413ecaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.021165:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:3.0:1788664466.021169:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025d55974/0xcd11f61c1413ecaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.021177:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025d55974/0xcd11f61c1413ecaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.021189:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025d55974/0xcd11f61c1413ecaa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.021218:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025d55974/0xcd11f61c1413ecaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.021233:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664466.021235:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664466.021237:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.021683:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788664466.021731:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664466.021737:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000173691ca/0xcd11f61c1413ecb1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.021746:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664466.021762:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664466.021768:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000173691ca/0xcd11f61c1413ecb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.021805:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000173691ca/0xcd11f61c1413ecb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.021814:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000173691ca/0xcd11f61c1413ecb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.021822:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000173691ca/0xcd11f61c1413ecb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.021835:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788664466.021842:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664466.021845:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000173691ca/0xcd11f61c1413ecb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.021852:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957c00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664466.021855:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000173691ca/0xcd11f61c1413ecb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.021871:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000173691ca/0xcd11f61c1413ecb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.021882:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000173691ca/0xcd11f61c1413ecb1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.021890:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000173691ca/0xcd11f61c1413ecb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.021902:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.021904:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.021906:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664466.023193:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664466.023204:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000694f3a1f/0xcd11f61c1413ecb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.023217:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664466.023221:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664466.023225:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000694f3a1f/0xcd11f61c1413ecb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.023236:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000694f3a1f/0xcd11f61c1413ecb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.023245:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000694f3a1f/0xcd11f61c1413ecb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.023253:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000694f3a1f/0xcd11f61c1413ecb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.023275:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788664466.023348:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664466.023355:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000694f3a1f/0xcd11f61c1413ecb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.023370:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030800 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:2.0:1788664466.023374:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000694f3a1f/0xcd11f61c1413ecb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.023382:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000694f3a1f/0xcd11f61c1413ecb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.023394:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000694f3a1f/0xcd11f61c1413ecb8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.023402:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000694f3a1f/0xcd11f61c1413ecb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.023427:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664466.023429:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664466.023431:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788664466.024742:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664466.024762:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ecbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.024794:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664466.024798:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664466.024804:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ecbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.024817:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ecbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.024826:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ecbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.024842:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ecbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.024856:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664466.025149:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664466.025156:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ecbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.025169:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956200 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664466.025173:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ecbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.025182:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ecbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.025196:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ecbf lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.025203:0:19537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ecbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.025219:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664466.025220:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664466.025222:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788664466.025323:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788664466.025339:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090af938b/0xcd11f61c1413ecc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.025349:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=561s v=(0 0) 00010000:00010000:2.0:1788664466.025352:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664466.025356:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090af938b/0xcd11f61c1413ecc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.025366:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090af938b/0xcd11f61c1413ecc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.025382:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090af938b/0xcd11f61c1413ecc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.025390:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090af938b/0xcd11f61c1413ecc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.025418:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664466.025442:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664466.025447:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090af938b/0xcd11f61c1413ecc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.025455:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e2a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664466.025458:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090af938b/0xcd11f61c1413ecc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.025466:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090af938b/0xcd11f61c1413ecc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.025484:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090af938b/0xcd11f61c1413ecc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.025491:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090af938b/0xcd11f61c1413ecc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.025517:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664466.025519:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664466.025521:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788664466.025663:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664466.025669:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413eccd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.025676:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664466.025679:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664466.025683:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413eccd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.025692:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413eccd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.025700:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413eccd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.025706:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413eccd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.025724:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788664466.025756:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664466.025761:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413eccd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.025786:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957e00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:2.0:1788664466.025791:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413eccd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.025799:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413eccd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.025811:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413eccd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.025818:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000816ed874/0xcd11f61c1413eccd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.025832:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664466.025839:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664466.025841:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788664466.027179:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664466.027187:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ecd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.027203:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664466.027206:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664466.027211:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ecd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.027222:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ecd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.027231:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ecd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.027238:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ecd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.027322:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788664466.028253:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788664466.028262:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011097d49/0xcd11f61c1413ecdb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.028274:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=561s v=(0 0) 00010000:00010000:2.0:1788664466.028278:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664466.028283:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011097d49/0xcd11f61c1413ecdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.028295:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011097d49/0xcd11f61c1413ecdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.028304:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011097d49/0xcd11f61c1413ecdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.028312:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011097d49/0xcd11f61c1413ecdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788664466.029522:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664466.029530:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ece2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.029541:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664466.029545:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664466.029550:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ece2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.029561:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ece2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.029584:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ece2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.029591:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ece2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.029660:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788664466.029668:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ecd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.029676:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957200 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664466.029680:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ecd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.029689:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ecd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.029705:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ecd4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.029713:0:19537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000488c7e8a/0xcd11f61c1413ecd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.029766:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788664466.029784:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011097d49/0xcd11f61c1413ecdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.029791:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c4029e3600 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664466.029794:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011097d49/0xcd11f61c1413ecdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.029802:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011097d49/0xcd11f61c1413ecdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.029813:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011097d49/0xcd11f61c1413ecdb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.029821:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664466.029824:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ece2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.029830:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664466.029833:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ece2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.029840:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ece2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.029862:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ece2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.029869:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664466.029871:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664466.029873:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.031170:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788664466.031179:0:19534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000983bfb01/0xcd11f61c1413ece2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.031248:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664466.031822:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664466.033725:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788664466.033738:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011097d49/0xcd11f61c1413ecdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664466.037522:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664466.037536:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ece9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.037554:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664466.037559:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664466.037565:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ece9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.037579:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ece9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.037590:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ece9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.037597:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ece9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.037698:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788664466.039190:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664466.039262:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ecf0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.039277:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664466.039281:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664466.039286:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ecf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.039297:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ecf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.039306:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ecf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.039313:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ecf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.039390:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788664466.039532:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664466.039540:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ece9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.039548:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400031400 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664466.039552:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ece9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.039560:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ece9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.039575:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ece9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.039582:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000928560a5/0xcd11f61c1413ece9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.039614:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664466.039617:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ecf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.039624:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400031a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664466.039626:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ecf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.039633:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ecf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.039643:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ecf0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.039649:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006037babc/0xcd11f61c1413ecf0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.039660:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.039661:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.039663:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664466.040095:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1788664466.040095:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788664466.040103:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ecf7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040103:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009056a327/0xcd11f61c1413ecfe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.040113:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664466.040114:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1788664466.040118:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664466.040118:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664466.040123:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ecf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040129:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009056a327/0xcd11f61c1413ecfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040139:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009056a327/0xcd11f61c1413ecfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.040143:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ecf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040147:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009056a327/0xcd11f61c1413ecfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.040151:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ecf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040155:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009056a327/0xcd11f61c1413ecfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.040158:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ecf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040168:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788664466.040507:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:1.0:1788664466.040547:0:18648:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:1.0:1788664466.040642:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17170:x1875550140572544:12345-0@lo:5:osp-pre-1-0.0 Request processed in 114466us (115600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664466.040652:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788664466.040680:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664466.040686:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009056a327/0xcd11f61c1413ecfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040693:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957800 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664466.040697:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009056a327/0xcd11f61c1413ecfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040705:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009056a327/0xcd11f61c1413ecfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664466.040710:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1875550140572544:0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1788664466.040716:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009056a327/0xcd11f61c1413ecfe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788664466.040724:0:17170:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00010000:00010000:0.0:1788664466.040734:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009056a327/0xcd11f61c1413ecfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040760:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664466.040764:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ecf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040790:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030400 already unused, calling callback (ffffffffc0c117b0) 00000100:00100000:1.0:1788664466.040791:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1875550140573824:0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1788664466.040794:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ecf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040801:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ecf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040811:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ecf7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040818:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f31708d/0xcd11f61c1413ecf7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664466.040825:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788664466.040832:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.040834:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.040836:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664466.040846:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42f6ba180 going to sleep for 11 seconds 00000100:00100000:1.0:1788664466.040860:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140573824 00000100:00100000:1.0:1788664466.040865:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140573824 00002000:00010000:0.0:1788664466.040876:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664466.040880:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ed05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664466.040894:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788664466.040894:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664466.040897:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1788664466.040901:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17170:x1875550140573824:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1788664466.040902:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ed05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040910:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ed05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040918:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ed05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040924:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ed05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040952:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788664466.040959:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664466.040962:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ed05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040969:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956200 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664466.040972:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ed05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.040979:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ed05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.041003:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ed05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.041010:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278a2c31/0xcd11f61c1413ed05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.041023:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.041025:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.041028:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788664466.041076:0:18648:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00002000:00010000:0.0:1788664466.041652:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664466.041658:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ed0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.041667:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664466.041671:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664466.041675:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ed0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.041684:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ed0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.041692:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ed0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.041699:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ed0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.041726:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664466.042022:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664466.042028:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ed0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.042037:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303956e00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664466.042040:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ed0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.042049:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ed0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.042062:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ed0c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.042070:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ab39bf/0xcd11f61c1413ed0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.042085:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664466.042087:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664466.042089:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788664466.042377:0:19534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788664466.042384:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ed13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.042393:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1788664466.042397:0:19534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664466.042401:0:19534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ed13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.042411:0:19534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ed13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.042418:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ed13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.042425:0:19534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ed13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.042440:0:19534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788664466.042471:0:19534:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:0.0:1788664466.042548:0:19534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17168:x1875550140573056:12345-0@lo:5:osp-pre-0-0.0 Request processed in 102047us (113914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664466.042557:0:19534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664466.042602:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303add880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1875550140573056:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788664466.042624:0:17168:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788664466.042659:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1875550140573952:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788664466.042689:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664466.042709:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c3010866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664466.042728:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140573952 00000100:00100000:0.0:1788664466.042734:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140573952 00010000:00010000:1.0:1788664466.042856:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664466.042861:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ed13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.042869:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303957a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664466.042873:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ed13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.042892:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ed13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.042905:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ed13 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.042912:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001865c55e/0xcd11f61c1413ed13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664466.042988:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664466.042991:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664466.042993:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664466.044028:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788664466.044040:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17168:x1875550140573952:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1788664466.044070:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788664466.044077:0:19229:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1788664466.044078:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664466.045624:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17170:x1875550140573824:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4718us (4793us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788664466.045634:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788664466.046231:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1875550140573824:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788664466.046247:0:17170:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000001:00080000:2.0:1788664466.057318:0:18645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788664466.057363:0:18645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788664466.057637:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17168:x1875550140573952:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13596us (14942us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788664466.057649:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788664466.057710:0:17168:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788664466.057720:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1875550140573952:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788664466.057738:0:17168:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1788664466.110884:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788664466.753195:0:17140:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788664466.753202:0:17140:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c42f768000 from 10 10000000:01000000:3.0:1788664466.753206:0:17140:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788664466.753251:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84400/0xcd11f61c1413ed1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.753262:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b84400/0xcd11f61c1413ed1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664466.753273:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b84400/0xcd11f61c1413ed1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664466.753309:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140574080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664466.753392:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664466.753440:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4119020c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664466.755760:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140574080 00000100:00100000:0.0:1788664466.755787:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140574080 00000100:00100000:0.0:1788664466.755844:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788664466.755853:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:17140:x1875550140574080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664466.755869:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664466.755886:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303957800/0xcd11f61c1413ed21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413ed1a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.755910:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303957800/0xcd11f61c1413ed21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413ed1a expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.755920:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303957800/0xcd11f61c1413ed21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413ed1a expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.755928:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957800, rc 0) 00000100:00100000:0.0:1788664466.756009:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:17140:x1875550140574080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (2628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664466.756015:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788664466.756072:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140574080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664466.756089:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b84400/0xcd11f61c1413ed1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ed21 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.756097:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b84400/0xcd11f61c1413ed1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413ed21 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664466.756165:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140574208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788664466.756198:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664466.756219:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4063d30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664466.756233:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140574208 00000100:00100000:0.0:1788664466.756236:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140574208 00000100:00100000:0.0:1788664466.756258:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788664466.756264:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:17140:x1875550140574208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788664466.756277:0:17137:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788664466.756292:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788664466.756295:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788664466.756367:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:17140:x1875550140574208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664466.756374:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788664466.756470:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140574208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788664466.756529:0:17140:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788664466.756536:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84400/0xcd11f61c1413ed1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ed21 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.756547:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b84400/0xcd11f61c1413ed1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ed21 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664466.756555:0:17140:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788664466.756557:0:17140:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff93c43f740000 from 10 10000000:01000000:0.0:1788664466.756559:0:17140:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788664466.756573:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303956a00/0xcd11f61c1413ed28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.756580:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303956a00/0xcd11f61c1413ed28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.756588:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303956a00/0xcd11f61c1413ed28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664466.756598:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140574336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788664466.756623:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664466.756636:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4063d30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664466.756646:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140574336 00000100:00100000:0.0:1788664466.756650:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140574336 00000100:00100000:0.0:1788664466.756670:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788664466.756676:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:17140:x1875550140574336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664466.756683:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664466.756691:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303957c00/0xcd11f61c1413ed2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413ed28 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.756704:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303957c00/0xcd11f61c1413ed2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413ed28 expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.756720:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303957c00/0xcd11f61c1413ed2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413ed28 expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.756726:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957c00, rc 0) 00000100:00100000:0.0:1788664466.756751:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:17140:x1875550140574336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664466.756756:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788664466.756801:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140574336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664466.756810:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303956a00/0xcd11f61c1413ed28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ed2f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.756818:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303956a00/0xcd11f61c1413ed28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413ed2f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664466.756852:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140574464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788664466.756877:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664466.756888:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4063d30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664466.756898:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140574464 00000100:00100000:0.0:1788664466.756900:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140574464 00000100:00100000:0.0:1788664466.756919:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788664466.756925:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:17140:x1875550140574464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788664466.756933:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788664466.756942:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788664466.756945:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788664466.757011:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:17140:x1875550140574464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 85us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664466.757026:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788664466.757055:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140574464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788664466.757091:0:17140:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788664466.757096:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303956a00/0xcd11f61c1413ed28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ed2f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.757102:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303956a00/0xcd11f61c1413ed28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ed2f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664467.138798:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788664467.902992:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788664468.160872:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664469.181915:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664470.206292:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664470.590010:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140574592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664470.590080:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664470.590376:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140574592 00000100:00100000:2.0:1788664470.590391:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140574592 00000100:00100000:2.0:1788664470.590456:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788664470.590466:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140574592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788664470.590506:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788664470.590559:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140574592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664470.590565:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788664470.590617:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140574592:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788664470.590734:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664471.102053:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3639:1875550140574720:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.102128:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.102173:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140575232:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.102209:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.102227:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140575744:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.102245:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.102260:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140576256:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.102285:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.102306:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788664471.102310:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140575104:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.102347:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.102366:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140575616:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.102583:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.102603:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140576128:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.102623:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.102654:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140574976:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.102677:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.102694:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140575488:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.102714:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.102728:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140576000:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.102746:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.102759:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788664471.102765:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140574848:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.102814:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.102834:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140575360:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.102855:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.102870:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140575872:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.102890:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.102900:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140576384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664471.102921:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.102952:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140574720 00000100:00100000:0.0:1788664471.102959:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140574720 00000100:00100000:0.0:1788664471.103005:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788664471.103014:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:3639:x1875550140574720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.103063:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:3639:x1875550140574720:12345-0@lo:400:kworker.0 Request processed in 50us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664471.103079:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788664471.103110:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140575232 00000100:00100000:0.0:1788664471.103114:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140575232 00000100:00100000:0.0:1788664471.103130:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140575744 00000100:00100000:0.0:1788664471.103132:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140575744 00000100:00100000:0.0:1788664471.103140:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140576256 00000100:00100000:0.0:1788664471.103142:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140576256 00000100:00100000:0.0:1788664471.103162:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140576128 00000100:00100000:0.0:1788664471.103165:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140576128 00000100:00100000:0.0:1788664471.103176:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140576000 00000100:00100000:0.0:1788664471.103178:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140576000 00000100:00100000:0.0:1788664471.103188:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140575872 00000100:00100000:0.0:1788664471.103191:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140575872 00000100:00100000:0.0:1788664471.103204:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788664471.103209:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140575232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.103242:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140575232:12345-0@lo:400:kworker.0 Request processed in 32us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664471.103247:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788664471.103259:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788664471.103265:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140575744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.103291:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875550140575744:12345-0@lo:400:kworker.0 Request processed in 26us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664471.103296:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788664471.103307:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788664471.103313:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140576256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.103337:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875550140576256:12345-0@lo:400:kworker.0 Request processed in 25us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664471.103343:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788664471.103362:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788664471.103368:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140576128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.103688:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875550140576128:12345-0@lo:400:kworker.0 Request processed in 318us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664471.103695:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788664471.103709:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788664471.103716:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140576000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.103755:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140576000:12345-0@lo:400:kworker.0 Request processed in 39us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664471.103761:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788664471.103802:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788664471.103809:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140575872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.103836:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140575872:12345-0@lo:400:kworker.0 Request processed in 28us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664471.103842:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788664471.103870:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140575104 00000100:00100000:0.0:1788664471.103875:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140575104 00000100:00100000:0.0:1788664471.103902:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140575616 00000100:00100000:0.0:1788664471.103904:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140575616 00000100:00100000:0.0:1788664471.103916:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140574976 00000100:00100000:0.0:1788664471.103918:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140574976 00000100:00100000:0.0:1788664471.103929:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140575488 00000100:00100000:0.0:1788664471.103932:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140575488 00000100:00100000:0.0:1788664471.103944:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788664471.103950:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1875550140575104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.103981:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1875550140575104:12345-0@lo:400:kworker.0 Request processed in 32us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664471.104327:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664471.104494:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140576512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664471.104531:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664471.104571:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788664471.104582:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140575616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664471.104615:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140575616:12345-0@lo:400:kworker.0 Request processed in 37us (2033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664471.104620:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788664471.104635:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788664471.104649:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140574976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664471.104679:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140574976:12345-0@lo:400:kworker.0 Request processed in 31us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664471.104685:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664471.104703:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788664471.104716:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788664471.104723:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140575488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.104753:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140575488:12345-0@lo:400:kworker.0 Request processed in 32us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664471.104758:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788664471.104804:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140574848 00000100:00100000:0.0:1788664471.104808:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140574848 00000100:00100000:0.0:1788664471.104832:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140575360 00000100:00100000:0.0:1788664471.104835:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140575360 00000100:00100000:0.0:1788664471.104847:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788664471.104852:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140574848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.104882:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140574848:12345-0@lo:400:kworker.0 Request processed in 30us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664471.104888:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788664471.104898:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788664471.104903:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140575360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.104930:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140575360:12345-0@lo:400:kworker.0 Request processed in 26us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664471.104936:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788664471.104955:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140576384 00000100:00100000:0.0:1788664471.104959:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140576384 00000100:00100000:0.0:1788664471.104975:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140576512 00000100:00100000:0.0:1788664471.104978:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140576512 00000100:00100000:0.0:1788664471.104988:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788664471.104993:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875550140576384:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664471.105145:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42266a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140576896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664471.105171:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664471.105309:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140576896 00000100:00100000:1.0:1788664471.105313:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140576896 00002000:00000024:0.0:1788664471.105608:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788664471.105642:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875550140576384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 649us (2720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664471.105649:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788664471.105661:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788664471.105667:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140576512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788664471.105692:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788664471.105724:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140576512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664471.105730:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788664471.105751:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788664471.105755:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664471.105757:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664471.105759:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788664471.105796:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140576640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664471.105822:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.105841:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664471.105847:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140576768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788664471.105867:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664471.105911:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140574848:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.105921:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140575360:0@lo:400:kworker.0 00010000:00080000:0.0:1788664471.105933:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3035a5f80 x1875550140575872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664471.105943:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140575872:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.105958:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140576384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664471.105976:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140574976:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.105984:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140575488:0@lo:400:kworker.0 00010000:00080000:0.0:1788664471.105994:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e7100 x1875550140576000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664471.106067:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140576768 00000100:00100000:1.0:1788664471.106072:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140576768 00000100:00100000:1.0:1788664471.106092:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788664471.106097:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140576896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664471.106119:0:17883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788664471.106150:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140576896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664471.106156:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788664471.106168:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788664471.106257:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140576768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788664471.106274:0:17883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788664471.106307:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140576768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664471.106313:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788664471.106563:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140576640 00000100:00100000:1.0:1788664471.106569:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140576640 00000100:00100000:1.0:1788664471.106593:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788664471.106599:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140576640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664471.106611:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788664471.106649:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140576640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664471.106654:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788664471.106690:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140576768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664471.106706:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140576640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664471.106740:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42266a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140576896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664471.106753:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140576512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664471.106823:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140575104:0@lo:400:kworker.0 00000100:00100000:1.0:1788664471.106833:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140575616:0@lo:400:kworker.0 00010000:00080000:1.0:1788664471.106845:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e7800 x1875550140576128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664471.106853:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1875550140576128:0@lo:400:kworker.0 00000100:00100000:1.0:1788664471.106862:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c4350fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3639:1875550140574720:0@lo:400:kworker.0 00010000:00080000:1.0:1788664471.106872:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3035a6300 x1875550140575232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664471.106880:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140575232:0@lo:400:kworker.0 00010000:00080000:1.0:1788664471.106890:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3035a7800 x1875550140575744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664471.106896:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875550140575744:0@lo:400:kworker.0 00010000:00080000:1.0:1788664471.106906:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c42f5e5f80 x1875550140576256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664471.106927:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1875550140576256:0@lo:400:kworker.0 00000100:00100000:0.0:1788664471.107097:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42f5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140576000:0@lo:400:kworker.0 00010000:00010000:3.0:1788664471.230214:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788664471.618347:0:19465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000040:00080000:3.0:1788664471.678691:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788664471.719557:0:19822:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788664472.270945:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788664472.853640:0:19874:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788664472.854185:0:19874:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788664473.277874:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788664473.742865:0:19924:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788664473.743130:0:19924:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788664474.028614:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664474.028830:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119514624 00000100:00100000:0.0:1788664474.028845:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119514624 00000100:00100000:0.0:1788664474.028908:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:0.0:1788664474.028916:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2389:x1875550119514624:12345-192.168.203.52@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788664474.028948:0:17136:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a698de9a-812c-492b-8656-53dc2bcfa114@192.168.203.52@tcp t0 exp 0000000000000000 cur 569 last 0 00000020:00000080:0.0:1788664474.028979:0:17136:0:(genops.c:1385:class_connect()) connect: client a698de9a-812c-492b-8656-53dc2bcfa114, cookie 0xcd11f61c1413ed36 00000100:00080000:0.0:1788664474.029115:0:17136:0:(import.c:65:import_set_state_nolock()) ffff93c3029b1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788664474.029194:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+5:2389:x1875550119514624:12345-192.168.203.52@tcp:250:mount.lustre.0 Request processed in 276us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664474.029202:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:3.0:1788664474.032189:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664474.032366:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119514752 00000100:00100000:0.0:1788664474.032380:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119514752 00000100:00100000:0.0:1788664474.032468:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:0.0:1788664474.032480:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+5:14877:x1875550119514752:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788664474.032503:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664474.032526:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303956200/0xcd11f61c1413ed3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d658 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664474.032584:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303956200/0xcd11f61c1413ed3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d658 expref: 6 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664474.032598:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303956200/0xcd11f61c1413ed3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d658 expref: 6 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664474.032608:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956200, rc 0) 00000100:00100000:0.0:1788664474.032687:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+6:14877:x1875550119514752:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 209us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664474.032696:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:3.0:1788664474.034433:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664474.034527:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119514880 00000100:00100000:2.0:1788664474.034543:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119514880 00000100:00100000:2.0:1788664474.034617:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:2.0:1788664474.034627:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+6:14877:x1875550119514880:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788664474.034760:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+6:14877:x1875550119514880:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 134us (340us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788664474.034808:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:3.0:1788664474.050320:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664474.050439:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119515008 00000100:00100000:2.0:1788664474.050464:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119515008 00000100:00100000:2.0:1788664474.050539:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:2.0:1788664474.050549:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3027edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+6:14877:x1875550119515008:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788664474.050566:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664474.050583:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4029e2c00/0xcd11f61c1413ed44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d65f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664474.050615:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e2c00/0xcd11f61c1413ed44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d65f expref: 7 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664474.050648:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4029e2c00/0xcd11f61c1413ed44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d65f expref: 7 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664474.050657:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e2c00, rc 0) 00000100:00100000:2.0:1788664474.050722:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3027edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+7:14877:x1875550119515008:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 174us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664474.050729:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:3.0:1788664474.058964:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664474.059193:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119515136 00000100:00100000:0.0:1788664474.059207:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119515136 00000100:00100000:0.0:1788664474.059289:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:0.0:1788664474.059302:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+7:14877:x1875550119515136:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788664474.059532:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+8:14877:x1875550119515136:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 232us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664474.059542:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:3.0:1788664474.062035:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664474.062152:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119515264 00000100:00100000:0.0:1788664474.062163:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119515264 00000100:00100000:0.0:1788664474.062237:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:0.0:1788664474.062248:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+8:14877:x1875550119515264:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788664474.062469:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+8:14877:x1875550119515264:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 222us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664474.062478:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:3.0:1788664474.074033:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664474.076927:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119515392 00000100:00100000:2.0:1788664474.076951:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119515392 00000100:00100000:2.0:1788664474.077181:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:2.0:1788664474.077196:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+8:14896:x1875550119515392:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788664474.077440:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+8:14896:x1875550119515392:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 247us (3429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664474.077459:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:3.0:1788664474.103439:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664474.104130:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119515520 00000100:00100000:0.0:1788664474.104161:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119515520 00000100:00100000:0.0:1788664474.104236:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:0.0:1788664474.104248:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+8:14896:x1875550119515520:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788664474.104437:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+8:14896:x1875550119515520:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 191us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664474.104457:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:3.0:1788664474.115898:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664474.118353:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119515648 00000100:00100000:2.0:1788664474.118376:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119515648 00000100:00100000:2.0:1788664474.118526:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:2.0:1788664474.118539:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+8:14896:x1875550119515648:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788664474.118855:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+8:14896:x1875550119515648:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 317us (2976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664474.118865:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:3.0:1788664474.123893:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664474.124032:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119515776 00000100:00100000:0.0:1788664474.124046:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119515776 00000100:00100000:0.0:1788664474.124125:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:0.0:1788664474.124138:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+8:14877:x1875550119515776:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788664474.124162:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664474.124186:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303957a00/0xcd11f61c1413ed4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d690 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664474.124223:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303957a00/0xcd11f61c1413ed4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d690 expref: 9 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664474.124235:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303957a00/0xcd11f61c1413ed4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d690 expref: 9 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664474.124246:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957a00, rc 0) 00000100:00100000:0.0:1788664474.124322:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+9:14877:x1875550119515776:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 187us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664474.124329:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:3.0:1788664474.128321:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664474.128459:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119515904 00000100:00100000:0.0:1788664474.128473:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119515904 00000100:00100000:0.0:1788664474.128545:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:0.0:1788664474.128557:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+9:14877:x1875550119515904:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788664474.128615:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788664474.128637:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788664474.128642:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788664474.128645:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788664474.128648:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788664474.128651:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788664474.131212:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+9:14877:x1875550119515904:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 2640us (2888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664474.131232:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:3.0:1788664474.134974:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664474.135157:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119516032 00000100:00100000:2.0:1788664474.135170:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119516032 00000100:00100000:2.0:1788664474.135249:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:2.0:1788664474.135260:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+9:14877:x1875550119516032:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788664474.135313:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664474.135338:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ed52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d697 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664474.135377:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ed52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d697 expref: 10 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664474.135389:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ed52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d697 expref: 10 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664474.135400:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c4029e2a00, rc 0) 00000100:00100000:2.0:1788664474.135630:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+10:14877:x1875550119516032:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 371us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664474.135639:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:3.0:1788664474.140300:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664474.140550:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119516160 00000100:00100000:0.0:1788664474.140563:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119516160 00000100:00100000:0.0:1788664474.140638:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:0.0:1788664474.140649:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3038bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+10:14877:x1875550119516160:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788664474.141134:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3038bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+10:14877:x1875550119516160:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 484us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664474.141144:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:3.0:1788664474.143181:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664474.143443:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119516288 00000100:00100000:2.0:1788664474.143537:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119516288 00000100:00100000:2.0:1788664474.143663:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:2.0:1788664474.143675:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3038b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+10:14877:x1875550119516288:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788664474.143907:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3038b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+10:14877:x1875550119516288:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 232us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664474.143915:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:2.0:1788664474.148737:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664474.148925:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119516416 00000100:00100000:0.0:1788664474.148938:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119516416 00000100:00100000:0.0:1788664474.149011:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:0.0:1788664474.149023:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3038b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+10:14902:x1875550119516416:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788664474.149243:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3038b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+10:14902:x1875550119516416:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 222us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664474.149252:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:3.0:1788664474.153645:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664474.154106:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119516544 00000100:00100000:2.0:1788664474.154119:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119516544 00000100:00100000:2.0:1788664474.154193:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:2.0:1788664474.154204:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+10:14902:x1875550119516544:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788664474.154430:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+10:14902:x1875550119516544:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 226us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664474.154439:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:3.0:1788664474.158237:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664474.158354:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664474.158515:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119516672 00000100:00100000:2.0:1788664474.158527:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119516672 00000100:00100000:2.0:1788664474.158588:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119516928 00000100:00100000:2.0:1788664474.158592:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119516928 00000100:00100000:2.0:1788664474.158622:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788664474.158678:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2389:x1875550119516672:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788664474.158720:0:18960:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8@192.168.203.52@tcp t0 exp 0000000000000000 cur 569 last 0 00000020:00000080:2.0:1788664474.158826:0:18960:0:(genops.c:1385:class_connect()) connect: client a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8, cookie 0xcd11f61c1413ed59 00000004:00100000:2.0:1788664474.158859:0:18960:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788664474.159121:0:18960:0:(import.c:65:import_set_state_nolock()) ffff93c4047e0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664474.159214:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:2389:x1875550119516672:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 537us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664474.166707:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1788664474.166729:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875550119516928:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788664474.166803:0:17144:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8@192.168.203.52@tcp t0 exp 0000000000000000 cur 569 last 0 00000020:00000080:1.0:1788664474.166909:0:17144:0:(genops.c:1385:class_connect()) connect: client a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8, cookie 0xcd11f61c1413ed60 00000004:00100000:1.0:1788664474.166944:0:17144:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788664474.166990:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00080000:1.0:1788664474.167218:0:17144:0:(import.c:65:import_set_state_nolock()) ffff93c30264c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664474.167306:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:2389:x1875550119516928:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 580us (8949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664474.167317:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788664474.175241:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664474.175279:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664474.175544:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664474.185233:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119517184 00000100:00100000:2.0:1788664474.185253:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119517184 00000100:00100000:2.0:1788664474.185665:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119517056 00000100:00100000:2.0:1788664474.185671:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119517056 00000100:00100000:2.0:1788664474.185690:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119516800 00000100:00100000:1.0:1788664474.186837:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1788664474.186864:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:14877:x1875550119517184:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788664474.186922:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788664474.187056:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:14877:x1875550119517184:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 204us (11828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664474.187065:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1788664474.187094:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1788664474.187102:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:0:x1875550119517056:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788664474.187122:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788664474.187164:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:0:x1875550119517056:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 63us (11885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664474.187191:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1788664474.189893:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119516800 00000100:00100000:2.0:1788664474.190078:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788664474.190092:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:0:x1875550119516800:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788664474.190136:0:18960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788664474.190241:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:0:x1875550119516800:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 152us (14695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664474.190269:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00080000:3.0:1788664474.190360:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788664474.190368:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664474.192756:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664474.193107:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119517312 00000100:00100000:0.0:1788664474.193120:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119517312 00000100:00100000:1.0:1788664474.194659:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1788664474.194688:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:14877:x1875550119517312:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788664474.194925:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:14877:x1875550119517312:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 252us (2181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664474.194933:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1788664474.202333:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664474.202389:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664474.202430:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664474.202557:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119517440 00000100:00100000:2.0:1788664474.202571:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119517440 00000100:00100000:2.0:1788664474.202623:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119517568 00000100:00100000:2.0:1788664474.202627:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119517568 00000100:00100000:2.0:1788664474.202648:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788664474.202657:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1875550119517440:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788664474.202708:0:18651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8@192.168.203.52@tcp t0 exp 0000000000000000 cur 569 last 0 00000020:00000080:2.0:1788664474.202749:0:18651:0:(genops.c:1385:class_connect()) connect: client a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8, cookie 0xcd11f61c1413ed67 00002000:00100000:2.0:1788664474.202764:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8/ffff93c4047e3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788664474.202818:0:18651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788664474.203085:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788664474.203126:0:18651:0:(import.c:65:import_set_state_nolock()) ffff93c4047e1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664474.203213:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:2389:x1875550119517440:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 554us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664474.203222:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788664474.203247:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:2.0:1788664474.203253:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1875550119517568:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788664474.203271:0:18651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8@192.168.203.52@tcp t0 exp 0000000000000000 cur 569 last 0 00000020:00000080:2.0:1788664474.203290:0:18651:0:(genops.c:1385:class_connect()) connect: client a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8, cookie 0xcd11f61c1413ed6e 00002000:00100000:2.0:1788664474.203296:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8/ffff93c4047e4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788664474.203310:0:18651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788664474.203461:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788664474.203479:0:18651:0:(import.c:65:import_set_state_nolock()) ffff93c4047e2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664474.203515:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:2389:x1875550119517568:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 260us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664474.203522:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788664474.203702:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119517696 00000100:00100000:1.0:1788664474.203709:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119517696 00000100:00100000:1.0:1788664474.203763:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1788664474.203805:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:14877:x1875550119517696:12345-192.168.203.52@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788664474.203848:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:14877:x1875550119517696:12345-192.168.203.52@tcp:900:mount.lustre.0 Request processed in 78us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664474.203855:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788664474.207219:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664474.207472:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119517824 00000100:00100000:0.0:1788664474.207503:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119517824 00000100:00100000:0.0:1788664474.207625:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1788664474.207638:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:14877:x1875550119517824:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788664474.211155:0:17146:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3391us 00000004:00200000:3.0:1788664474.236574:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788664474.236742:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:14877:x1875550119517824:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 29099us (29530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664474.236759:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00010000:00010000:3.0:1788664474.302310:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664474.382597:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664474.382711:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119517952 00000100:00100000:1.0:1788664474.382730:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119517952 00000100:00100000:1.0:1788664474.382981:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1788664474.382995:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:14925:x1875550119517952:12345-192.168.203.52@tcp:101:mkdir.0 00010000:00010000:1.0:1788664474.383025:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664474.383065:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413ed75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d6c8 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664474.383153:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413ed7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664474.383170:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413ed7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664474.383205:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413ed7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664474.383283:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788664474.383288:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664474.383346:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413ed7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664474.383379:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030400/0xcd11f61c1413ed75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d6c8 expref: 8 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664474.383404:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413ed7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d6c8 expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664474.383415:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6600) 00010000:00010000:1.0:1788664474.383418:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788664474.383422:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400030c00, rc 0) 00000100:00100000:1.0:1788664474.383651:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+7:14925:x1875550119517952:12345-192.168.203.52@tcp:101:mkdir.0 Request processed in 658us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664474.383660:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00010000:00010000:0.0:1788664475.329464:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664475.714686:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664475.714720:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140577024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664475.714838:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664475.718988:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140577024 00000100:00100000:2.0:1788664475.719025:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140577024 00000100:00100000:2.0:1788664475.719134:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788664475.719147:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140577024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788664475.719183:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788664475.719304:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140577024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 160us (4466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664475.719313:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788664475.719814:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664475.719882:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140577024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788664476.222171:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c422668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140577152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664476.222267:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664476.222473:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140577280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664476.222509:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664476.222614:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140577152 00000100:00100000:3.0:1788664476.222625:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140577152 00000100:00100000:3.0:1788664476.222685:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140577280 00000100:00100000:3.0:1788664476.222688:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140577280 00000100:00100000:3.0:1788664476.222725:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788664476.222736:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140577152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788664476.222840:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788664476.222888:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140577152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664476.222896:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788664476.222915:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788664476.222921:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140577280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788664476.222938:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788664476.222966:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140577280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664476.222971:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788664476.222986:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664476.222991:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664476.223029:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140577280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664476.223529:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c422668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140577152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788664476.224238:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3639:1875550140577792:0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.224573:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140577536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664476.224958:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140577408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788664476.225047:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664476.225095:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140578048:0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.225140:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664476.225160:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140578560:0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.225187:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664476.225205:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140579072:0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.225227:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664476.225267:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140577536 00000100:00100000:1.0:1788664476.225287:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140577536 00000100:00100000:1.0:1788664476.225347:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788664476.225358:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140577536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788664476.225405:0:17883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788664476.225468:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140577536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664476.225476:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788664476.225502:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140578560 00000100:00100000:1.0:1788664476.225505:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140578560 00000100:00100000:1.0:1788664476.225533:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140579072 00000100:00100000:1.0:1788664476.225535:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140579072 00000100:00100000:1.0:1788664476.225567:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788664476.225573:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140578560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.225609:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140578560:12345-0@lo:400:kworker.0 Request processed in 35us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664476.225614:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788664476.225625:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788664476.225631:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140579072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.225657:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140579072:12345-0@lo:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664476.225674:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788664476.225714:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788664476.225754:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140577536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664476.225768:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140578560:0@lo:400:kworker.0 00010000:00080000:1.0:1788664476.225819:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b9ca80 x1875550140579072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664476.225830:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140579072:0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.225896:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140578048 00000100:00100000:1.0:1788664476.225900:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140578048 00000100:00100000:1.0:1788664476.225946:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788664476.225955:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c422669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140578048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.225996:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c422669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140578048:12345-0@lo:400:kworker.0 Request processed in 44us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664476.226002:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788664476.226017:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788664476.226033:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788664476.226048:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140578048:0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.226067:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140577664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664476.226098:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664476.226123:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140578176:0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.226144:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664476.226160:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140578688:0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.226181:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664476.226218:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140578176 00000100:00100000:1.0:1788664476.226221:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140578176 00000100:00100000:1.0:1788664476.226242:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140578688 00000100:00100000:1.0:1788664476.226245:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140578688 00000100:00100000:1.0:1788664476.226264:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788664476.226270:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140578176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.226306:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140578176:12345-0@lo:400:kworker.0 Request processed in 36us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664476.226313:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788664476.226325:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788664476.226331:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140578688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.226358:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140578688:12345-0@lo:400:kworker.0 Request processed in 27us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664476.226363:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788664476.226377:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664476.226396:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140578176:0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.226406:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140578688:0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.226475:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140577664 00000100:00100000:1.0:1788664476.226478:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140577664 00000100:00100000:1.0:1788664476.226503:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788664476.226510:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140577664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664476.226524:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788664476.226561:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140577664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664476.226567:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788664476.226595:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140577664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664476.234728:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664476.234855:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140578304:0@lo:400:kworker.0 00000100:00100000:0.0:1788664476.234925:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664476.234970:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140578816:0@lo:400:kworker.0 00000100:00100000:0.0:1788664476.235004:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664476.235077:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140578816 00000100:00100000:0.0:1788664476.235087:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140578816 00000100:00100000:0.0:1788664476.235159:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788664476.235170:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140578816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664476.235243:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140578816:12345-0@lo:400:kworker.0 Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664476.235252:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788664476.235294:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664476.235475:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140578304 00000100:00100000:2.0:1788664476.235481:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140578304 00000100:00100000:2.0:1788664476.235517:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788664476.235525:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140578304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664476.235574:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140578304:12345-0@lo:400:kworker.0 Request processed in 49us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664476.235580:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788664476.236016:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140578304:0@lo:400:kworker.0 00010000:00080000:0.0:1788664476.236032:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b9f100 x1875550140578816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664476.236042:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140578816:0@lo:400:kworker.0 00000100:00100000:3.0:1788664476.236151:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664476.236192:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140577920:0@lo:400:kworker.0 00000100:00100000:3.0:1788664476.236223:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664476.236249:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140578432:0@lo:400:kworker.0 00000100:00100000:3.0:1788664476.236287:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664476.236316:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140578944:0@lo:400:kworker.0 00000100:00100000:3.0:1788664476.236348:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664476.236387:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140578944 00000100:00100000:3.0:1788664476.236391:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140578944 00000100:00100000:3.0:1788664476.236453:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788664476.236463:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140578944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664476.236521:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875550140578944:12345-0@lo:400:kworker.0 Request processed in 59us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664476.236528:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788664476.236550:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664476.236568:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1875550140578944:0@lo:400:kworker.0 00000100:00100000:2.0:1788664476.236741:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140577408 00000100:00100000:2.0:1788664476.236745:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140577408 00000100:00100000:2.0:1788664476.236794:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140577920 00000100:00100000:2.0:1788664476.236814:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140577920 00000100:00100000:2.0:1788664476.236832:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788664476.236839:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140577408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788664476.236874:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788664476.236927:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140577408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664476.236934:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788664476.236947:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788664476.236953:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140577920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664476.236981:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140577920:12345-0@lo:400:kworker.0 Request processed in 28us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664476.236987:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788664476.237730:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140577792 00000100:00100000:1.0:1788664476.237739:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140577792 00000100:00100000:1.0:1788664476.237831:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788664476.237841:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:3639:x1875550140577792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.237895:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:3639:x1875550140577792:12345-0@lo:400:kworker.0 Request processed in 56us (3178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664476.237902:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788664476.237937:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140578432 00000100:00100000:1.0:1788664476.237941:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140578432 00000100:00100000:1.0:1788664476.237970:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788664476.237977:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140578432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.238006:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140578432:12345-0@lo:400:kworker.0 Request processed in 30us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664476.238012:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788664476.238200:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140577408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788664476.238213:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140577920:0@lo:400:kworker.0 00000100:00100000:3.0:1788664476.238225:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140578432:0@lo:400:kworker.0 00000100:00100000:0.0:1788664476.238728:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3639:1875550140577792:0@lo:400:kworker.0 00010000:00010000:3.0:1788664476.351660:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664476.647255:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664476.648245:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119518080 00000100:00100000:0.0:1788664476.648301:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119518080 00000100:00100000:0.0:1788664476.648446:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1788664476.648459:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+7:14977:x1875550119518080:12345-192.168.203.52@tcp:41:lfs.0 00000004:00000024:0.0:1788664476.648923:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788664476.649065:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+7:14977:x1875550119518080:12345-192.168.203.52@tcp:41:lfs.0 Request processed in 606us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664476.649075:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00080000:3.0:1788664476.649617:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664476.652897:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664476.653475:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119518208 00000100:00100000:1.0:1788664476.653488:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119518208 00000100:00100000:1.0:1788664476.653596:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1788664476.653607:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:14977:x1875550119518208:12345-192.168.203.52@tcp:41:lfs.0 00000004:00000024:1.0:1788664476.653651:0:18960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788664476.653829:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:14977:x1875550119518208:12345-192.168.203.52@tcp:41:lfs.0 Request processed in 222us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664476.653837:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00080000:3.0:1788664476.654672:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788664476.664952:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664476.665978:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119518336 00000100:00100000:3.0:1788664476.665994:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119518336 00000100:00100000:3.0:1788664476.666176:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1788664476.666200:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:14977:x1875550119518336:12345-192.168.203.52@tcp:13:lfs.0 00002000:00000024:3.0:1788664476.666237:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788664476.667022:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:14977:x1875550119518336:12345-192.168.203.52@tcp:13:lfs.0 Request processed in 830us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664476.667034:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00080000:0.0:1788664476.667405:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664476.671209:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664476.671492:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119518464 00000100:00100000:3.0:1788664476.671505:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119518464 00000100:00100000:3.0:1788664476.671641:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1788664476.671654:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:14977:x1875550119518464:12345-192.168.203.52@tcp:13:lfs.0 00002000:00000024:3.0:1788664476.671725:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788664476.672637:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:14977:x1875550119518464:12345-192.168.203.52@tcp:13:lfs.0 Request processed in 231us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664476.672654:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00080000:0.0:1788664476.676152:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664476.886307:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664476.886527:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119518592 00000100:00100000:0.0:1788664476.886544:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119518592 00000100:00100000:0.0:1788664476.886637:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:0.0:1788664476.886650:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+10:15009:x1875550119518592:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788664476.886675:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664476.886700:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303956e00/0xcd11f61c1413ed83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d6cf expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.886740:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303956e00/0xcd11f61c1413ed83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d6cf expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.886755:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303956e00/0xcd11f61c1413ed83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d6cf expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.886767:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303956e00, rc 0) 00000100:00100000:0.0:1788664476.886921:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+11:15009:x1875550119518592:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 272us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664476.886929:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:2.0:1788664476.906900:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664476.907176:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119518720 00000100:00100000:0.0:1788664476.907217:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119518720 00000100:00100000:0.0:1788664476.907294:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:0.0:1788664476.907306:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43f784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+11:15009:x1875550119518720:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788664476.907741:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43f784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+11:15009:x1875550119518720:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 435us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664476.907751:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:3.0:1788664476.916482:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664476.921821:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119518848 00000100:00100000:1.0:1788664476.921837:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119518848 00000100:00100000:1.0:1788664476.921925:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:1.0:1788664476.921936:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+11:15009:x1875550119518848:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788664476.922358:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+11:15009:x1875550119518848:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 423us (5884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664476.922367:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:3.0:1788664476.948364:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664476.951185:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119518976 00000100:00100000:2.0:1788664476.951201:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119518976 00000100:00100000:2.0:1788664476.951272:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:2.0:1788664476.951293:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+11:15016:x1875550119518976:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788664476.951597:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+11:15016:x1875550119518976:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 315us (3241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664476.951606:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:2.0:1788664476.984704:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664476.984811:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119519104 00000100:00100000:0.0:1788664476.984819:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119519104 00000100:00100000:0.0:1788664476.984867:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:0.0:1788664476.984876:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+11:15016:x1875550119519104:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788664476.985019:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+11:15016:x1875550119519104:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 143us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664476.985027:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:3.0:1788664477.001029:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664477.005107:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119519232 00000100:00100000:1.0:1788664477.005122:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119519232 00000100:00100000:1.0:1788664477.005310:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:1.0:1788664477.005322:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c402f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+11:15016:x1875550119519232:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788664477.005501:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c402f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+11:15016:x1875550119519232:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 180us (4480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664477.005509:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:3.0:1788664477.008540:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664477.008703:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119519360 00000100:00100000:2.0:1788664477.008713:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119519360 00000100:00100000:2.0:1788664477.008961:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00100000:2.0:1788664477.008973:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+11:15009:x1875550119519360:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788664477.009001:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664477.009019:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413ed8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d700 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664477.009049:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413ed8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d700 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664477.009075:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0d400/0xcd11f61c1413ed8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d700 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664477.009084:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d400, rc 0) 00000100:00100000:2.0:1788664477.009140:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+12:15009:x1875550119519360:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 170us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664477.009146:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00100000:2.0:1788664477.015599:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664477.015887:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119519488 00000100:00100000:1.0:1788664477.015898:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119519488 00000100:00100000:1.0:1788664477.015985:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:1.0:1788664477.016005:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+12:15009:x1875550119519488:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788664477.016032:0:17137:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788664477.016056:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788664477.016061:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788664477.016064:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788664477.016067:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788664477.016069:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788664477.018754:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+12:15009:x1875550119519488:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 2741us (3154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664477.018768:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:3.0:1788664477.030052:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664477.030261:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119519616 00000100:00100000:0.0:1788664477.030271:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119519616 00000100:00100000:0.0:1788664477.030328:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:0.0:1788664477.030338:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+12:15009:x1875550119519616:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788664477.030354:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664477.030371:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303957200/0xcd11f61c1413ed91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d707 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664477.030398:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303957200/0xcd11f61c1413ed91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d707 expref: 13 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664477.030409:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303957200/0xcd11f61c1413ed91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d707 expref: 13 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664477.030452:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303957200, rc 0) 00000100:00100000:0.0:1788664477.030511:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+13:15009:x1875550119519616:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 175us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664477.030519:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:2.0:1788664477.034605:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664477.035395:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119519744 00000100:00100000:1.0:1788664477.035420:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119519744 00000100:00100000:1.0:1788664477.035607:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:1.0:1788664477.035618:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+13:15009:x1875550119519744:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788664477.036212:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+13:15009:x1875550119519744:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 593us (1615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664477.036221:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:3.0:1788664477.041266:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664477.041362:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119519872 00000100:00100000:2.0:1788664477.041372:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119519872 00000100:00100000:2.0:1788664477.041433:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00100000:2.0:1788664477.041444:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+13:15009:x1875550119519872:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788664477.041587:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+13:15009:x1875550119519872:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 143us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664477.041595:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00100000:3.0:1788664477.051992:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664477.052281:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119520000 00000100:00100000:1.0:1788664477.052292:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119520000 00000100:00100000:1.0:1788664477.052352:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:1.0:1788664477.052362:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+13:15021:x1875550119520000:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788664477.052634:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+13:15021:x1875550119520000:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 272us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664477.052642:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:1.0:1788664477.065509:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664477.074858:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119520128 00000100:00100000:0.0:1788664477.074871:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119520128 00000100:00100000:0.0:1788664477.074926:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:0.0:1788664477.074935:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+13:15021:x1875550119520128:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788664477.075256:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+13:15021:x1875550119520128:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 321us (9754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664477.075265:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:3.0:1788664477.100093:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664477.100413:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119520256 00000100:00100000:1.0:1788664477.100422:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119520256 00000100:00100000:1.0:1788664477.100480:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1788664477.100489:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875550119520256:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788664477.100521:0:17144:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 24b2763c-9677-4c1d-9630-d8d0d4c5653c@192.168.203.52@tcp t0 exp 0000000000000000 cur 572 last 0 00000020:00000080:1.0:1788664477.100566:0:17144:0:(genops.c:1385:class_connect()) connect: client 24b2763c-9677-4c1d-9630-d8d0d4c5653c, cookie 0xcd11f61c1413ed98 00000004:00100000:1.0:1788664477.100591:0:17144:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788664477.100689:0:17144:0:(import.c:65:import_set_state_nolock()) ffff93c4075fe000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664477.100799:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:2389:x1875550119520256:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 283us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664477.100807:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788664477.104401:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664477.104454:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119520512 00000100:00100000:1.0:1788664477.104465:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119520512 00000100:00100000:1.0:1788664477.104516:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788664477.104524:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2389:x1875550119520512:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788664477.104560:0:18960:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 24b2763c-9677-4c1d-9630-d8d0d4c5653c@192.168.203.52@tcp t0 exp 0000000000000000 cur 572 last 0 00000020:00000080:1.0:1788664477.104603:0:18960:0:(genops.c:1385:class_connect()) connect: client 24b2763c-9677-4c1d-9630-d8d0d4c5653c, cookie 0xcd11f61c1413ed9f 00000004:00100000:1.0:1788664477.104626:0:18960:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788664477.104850:0:18960:0:(import.c:65:import_set_state_nolock()) ffff93c435287800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664477.104920:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:2389:x1875550119520512:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 394us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664477.104928:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:2.0:1788664477.118205:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664477.120053:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119520640 00000100:00100000:1.0:1788664477.120067:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119520640 00000100:00100000:1.0:1788664477.120161:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1788664477.120172:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:0:x1875550119520640:12345-192.168.203.52@tcp:41:mount.lustre.0 00000100:00080000:0.0:1788664477.120361:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788664477.121038:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000004:00000024:1.0:1788664477.121166:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788664477.121845:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:0:x1875550119520640:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 1670us (3643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664477.121855:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788664477.122964:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664477.123013:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664477.123090:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119520768 00000100:00100000:1.0:1788664477.123097:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119520768 00000100:00100000:1.0:1788664477.123141:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119520384 00000100:00100000:1.0:1788664477.123144:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119520384 00000100:00100000:1.0:1788664477.123158:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:1.0:1788664477.123167:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+7:15009:x1875550119520768:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788664477.123202:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788664477.123823:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:1.0:1788664477.123931:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+7:15009:x1875550119520768:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 764us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664477.123939:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00080000:3.0:1788664477.124500:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664477.133858:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:0:x1875550119520384:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788664477.133904:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788664477.142380:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:0:x1875550119520384:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 18537us (19354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664477.142393:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1788664477.146052:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664477.146807:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119520896 00000100:00100000:0.0:1788664477.146822:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119520896 00000100:00100000:2.0:1788664477.146976:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:2.0:1788664477.147000:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:15009:x1875550119520896:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788664477.147095:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:15009:x1875550119520896:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 109us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664477.147103:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1788664477.150578:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664477.150618:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664477.150654:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664477.150813:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119521024 00000100:00100000:2.0:1788664477.150823:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119521024 00000100:00100000:2.0:1788664477.150849:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119521152 00000100:00100000:2.0:1788664477.150851:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119521152 00000100:00100000:2.0:1788664477.150864:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1788664477.150960:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:1.0:1788664477.150966:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1875550119521152:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788664477.151001:0:18648:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 24b2763c-9677-4c1d-9630-d8d0d4c5653c@192.168.203.52@tcp t0 exp 0000000000000000 cur 572 last 0 00000020:00000080:1.0:1788664477.151035:0:18648:0:(genops.c:1385:class_connect()) connect: client 24b2763c-9677-4c1d-9630-d8d0d4c5653c, cookie 0xcd11f61c1413eda6 00002000:00100000:1.0:1788664477.151045:0:18648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 24b2763c-9677-4c1d-9630-d8d0d4c5653c/ffff93c435282800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788664477.151060:0:18648:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788664477.151143:0:18648:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1788664477.151222:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1875550119521024:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788664477.151239:0:19229:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 24b2763c-9677-4c1d-9630-d8d0d4c5653c@192.168.203.52@tcp t0 exp 0000000000000000 cur 572 last 0 00000020:00000080:2.0:1788664477.151256:0:19229:0:(genops.c:1385:class_connect()) connect: client 24b2763c-9677-4c1d-9630-d8d0d4c5653c, cookie 0xcd11f61c1413edad 00002000:00100000:2.0:1788664477.151262:0:19229:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 24b2763c-9677-4c1d-9630-d8d0d4c5653c/ffff93c4047e5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788664477.151268:0:19229:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788664477.151309:0:19229:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788664477.151400:0:18648:0:(import.c:65:import_set_state_nolock()) ffff93c435283800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664477.151472:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:2389:x1875550119521152:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 504us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664477.151480:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00080000:2.0:1788664477.151806:0:19229:0:(import.c:65:import_set_state_nolock()) ffff93c4047e7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664477.152076:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:2389:x1875550119521024:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 1204us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664477.152084:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1788664477.152264:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119521280 00000100:00100000:0.0:1788664477.152271:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119521280 00000100:00100000:0.0:1788664477.152318:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1788664477.152327:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42f5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:15009:x1875550119521280:12345-192.168.203.52@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788664477.152390:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42f5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:15009:x1875550119521280:12345-192.168.203.52@tcp:900:mount.lustre.0 Request processed in 64us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664477.152396:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1788664477.160110:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664477.160337:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119521408 00000100:00100000:3.0:1788664477.160347:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119521408 00000100:00100000:3.0:1788664477.160406:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:3.0:1788664477.160417:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:15009:x1875550119521408:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788664477.160515:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788664477.160602:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:15009:x1875550119521408:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 186us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664477.160610:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00010000:00010000:3.0:1788664477.374132:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664477.419645:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664477.419797:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119521536 00000100:00100000:1.0:1788664477.419811:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119521536 00000100:00100000:1.0:1788664477.419872:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:1.0:1788664477.419881:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:15044:x1875550119521536:12345-192.168.203.52@tcp:101:mkdir.0 00010000:00010000:1.0:1788664477.419917:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664477.419937:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031a00/0xcd11f61c1413edb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d738 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664477.420008:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413edbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664477.420023:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413edbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664477.420034:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413edbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664477.420074:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788664477.420078:0:18960:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664477.420096:0:18960:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413edbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664477.420122:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031a00/0xcd11f61c1413edb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d738 expref: 8 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664477.420140:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413edbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d738 expref: 7 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664477.420149:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6600) 00010000:00010000:1.0:1788664477.420152:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788664477.420155:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400031400, rc 0) 00000100:00100000:1.0:1788664477.420217:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+7:15044:x1875550119521536:12345-192.168.203.52@tcp:101:mkdir.0 Request processed in 336us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664477.420224:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00010000:00010000:0.0:1788664478.401400:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664479.421910:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788664479.811590:0:17875:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 24b2763c-9677-4c1d-9630-d8d0d4c5653c 00000001:00100000:0.0:1788664479.811601:0:17875:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8 00000001:00100000:2.0:1788664479.814251:0:18645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 24b2763c-9677-4c1d-9630-d8d0d4c5653c 00000001:00100000:2.0:1788664479.814265:0:18645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8 00000001:00100000:1.0:1788664479.814345:0:19465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 24b2763c-9677-4c1d-9630-d8d0d4c5653c 00000001:00100000:1.0:1788664479.814352:0:19465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8 00000001:00100000:3.0:1788664479.814584:0:17123:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 24b2763c-9677-4c1d-9630-d8d0d4c5653c 00000001:00100000:3.0:1788664479.814605:0:17123:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8 00010000:00010000:3.0:1788664480.447103:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664480.843995:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140579200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664480.844061:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664480.851860:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140579200 00000100:00100000:3.0:1788664480.851878:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140579200 00000100:00100000:3.0:1788664480.851964:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788664480.851975:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140579200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788664480.852006:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788664480.852082:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140579200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (8020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664480.852089:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788664480.852109:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664480.852147:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140579200:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1788664481.070237:0:20022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788664481.342115:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140579328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664481.342181:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664481.342265:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140579456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664481.342295:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664481.342322:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664481.342329:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3035a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140579584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664481.342352:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664481.342382:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140579328 00000100:00100000:1.0:1788664481.342389:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140579328 00000100:00100000:1.0:1788664481.342443:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140579584 00000100:00100000:1.0:1788664481.342447:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140579584 00000100:00100000:1.0:1788664481.342463:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788664481.342471:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140579328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664481.342499:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788664481.342542:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140579328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664481.342550:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788664481.342568:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788664481.342574:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140579584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788664481.342584:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788664481.342613:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140579584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664481.342620:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788664481.342637:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140579456 00000100:00100000:1.0:1788664481.342649:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140579456 00000100:00100000:1.0:1788664481.342676:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788664481.342682:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140579456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788664481.342703:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788664481.342734:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140579456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664481.342740:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788664481.342760:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788664481.342817:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140579584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664481.342831:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140579456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664481.342866:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3035a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140579328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664481.345071:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140579712:0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.345129:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664481.345168:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140580224:0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.345195:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664481.345214:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140580736:0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.345237:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664481.345262:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788664481.345270:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140579840:0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.345292:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664481.345309:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140580352:0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.345333:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664481.345350:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140580864:0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.345371:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664481.345436:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140579712 00000100:00100000:1.0:1788664481.345443:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140579712 00000100:00100000:1.0:1788664481.345484:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788664481.345492:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:3638:x1875550140579712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.345538:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:3638:x1875550140579712:12345-0@lo:400:kworker.0 Request processed in 47us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664481.345546:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788664481.345576:0:19534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140580224 00000100:00100000:1.0:1788664481.345580:0:19534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140580224 00000100:00100000:1.0:1788664481.345603:0:19534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140579840 00000100:00100000:1.0:1788664481.345606:0:19534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140579840 00000100:00100000:1.0:1788664481.345631:0:19534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788664481.345637:0:19534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140580224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.345669:0:19534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140580224:12345-0@lo:400:kworker.0 Request processed in 33us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664481.345675:0:19534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788664481.345685:0:19534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788664481.345691:0:19534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140579840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.345717:0:19534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140579840:12345-0@lo:400:kworker.0 Request processed in 26us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664481.345722:0:19534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788664481.345740:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140580736 00000100:00100000:1.0:1788664481.345743:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140580736 00000100:00100000:1.0:1788664481.345767:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140580352 00000100:00100000:1.0:1788664481.345798:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140580352 00000100:00100000:1.0:1788664481.345812:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140580864 00000100:00100000:1.0:1788664481.345814:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140580864 00000100:00100000:1.0:1788664481.345830:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788664481.345835:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140580736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.352438:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140580736:12345-0@lo:400:kworker.0 Request processed in 6593us (7190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664481.352453:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788664481.352489:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788664481.352501:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140580352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.352544:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140580352:12345-0@lo:400:kworker.0 Request processed in 47us (7210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664481.352549:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788664481.352562:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788664481.352569:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140580864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.352598:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140580864:12345-0@lo:400:kworker.0 Request processed in 30us (7225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664481.352603:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788664481.352660:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140580096:0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.352697:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664481.352731:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140580608:0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.352754:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664481.352796:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788664481.352804:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140579968:0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.352826:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664481.352844:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140580480:0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.352862:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664481.352877:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140580992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664481.352899:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664481.353261:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140580096 00000100:00100000:2.0:1788664481.353269:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140580096 00000100:00100000:2.0:1788664481.353308:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788664481.353315:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140580096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664481.354133:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140580096:12345-0@lo:400:kworker.0 Request processed in 816us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664481.354143:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788664481.356841:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664481.356865:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140581120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788664481.356950:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664481.357026:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140579840:0@lo:400:kworker.0 00000100:00100000:2.0:1788664481.357052:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140580352:0@lo:400:kworker.0 00010000:00080000:2.0:1788664481.357067:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b9f480 x1875550140580864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664481.357077:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140580864:0@lo:400:kworker.0 00000100:00100000:2.0:1788664481.357087:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140579712:0@lo:400:kworker.0 00000100:00100000:2.0:1788664481.357097:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140580224:0@lo:400:kworker.0 00000100:00100000:2.0:1788664481.357112:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140580736:0@lo:400:kworker.0 00000100:00100000:0.0:1788664481.357722:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140581120 00000100:00100000:0.0:1788664481.357730:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140581120 00000100:00100000:0.0:1788664481.357798:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788664481.357808:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140581120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788664481.357841:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788664481.357895:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140581120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664481.358022:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788664481.358064:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140581120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788664481.361262:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140580608 00000100:00100000:0.0:1788664481.361277:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140580608 00000100:00100000:0.0:1788664481.361348:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140579968 00000100:00100000:0.0:1788664481.361351:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140579968 00000100:00100000:0.0:1788664481.361374:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140580480 00000100:00100000:0.0:1788664481.361377:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140580480 00000100:00100000:0.0:1788664481.361414:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788664481.361423:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140580608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664481.361507:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875550140580608:12345-0@lo:400:kworker.0 Request processed in 85us (8751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664481.361515:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788664481.361546:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788664481.361552:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140579968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664481.361586:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875550140579968:12345-0@lo:400:kworker.0 Request processed in 34us (8759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664481.361591:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788664481.361602:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788664481.361608:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140580480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664481.361634:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875550140580480:12345-0@lo:400:kworker.0 Request processed in 27us (8770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664481.361640:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788664481.361657:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788664481.361661:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664481.361664:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664481.361938:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140580096:0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.361958:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140580992 00000100:00100000:1.0:1788664481.361962:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140580992 00000100:00100000:1.0:1788664481.362006:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788664481.362013:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c30480f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140580992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664481.362031:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788664481.362069:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c30480f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140580992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (9169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664481.362075:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788664481.362103:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c303b9ed80 x1875550140580608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664481.362114:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1875550140580608:0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.362140:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875550140579968:0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.362150:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1875550140580480:0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.362164:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c304831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140580992:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788664481.470066:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788664481.919437:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788664482.456180:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664482.456225:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664482.456250:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664482.456272:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664482.456289:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664482.456322:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664482.456342:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664482.456363:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664482.456405:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664482.456443:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119522176 00000100:00100000:3.0:1788664482.456454:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119522176 00000100:00100000:0.0:1788664482.456551:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119521664 00000100:00100000:0.0:1788664482.456556:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119521664 00000100:00100000:0.0:1788664482.456607:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:0.0:1788664482.456618:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+13:2392:x1875550119521664:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664482.456692:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+13:2392:x1875550119521664:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 76us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664482.456699:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:0.0:1788664482.456733:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119521920 00000100:00100000:0.0:1788664482.456736:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119521920 00000100:00100000:0.0:1788664482.456766:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119522432 00000100:00100000:0.0:1788664482.456792:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119522432 00000100:00100000:0.0:1788664482.456808:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119521792 00000100:00100000:0.0:1788664482.456811:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119521792 00000100:00100000:0.0:1788664482.456847:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119522304 00000100:00100000:0.0:1788664482.456861:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119522304 00000100:00100000:0.0:1788664482.456883:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1788664482.456891:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2392:x1875550119521920:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664482.456923:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2392:x1875550119521920:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664482.456930:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1788664482.456943:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:0.0:1788664482.456949:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2392:x1875550119522432:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664482.456971:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2392:x1875550119522432:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 22us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664482.456977:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:3.0:1788664482.457154:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119522688 00000100:00100000:3.0:1788664482.457159:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119522688 00000100:00100000:3.0:1788664482.457183:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119522048 00000100:00100000:3.0:1788664482.457186:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119522048 00000100:00100000:3.0:1788664482.457198:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119522560 00000100:00100000:3.0:1788664482.457201:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119522560 00000100:00100000:3.0:1788664482.457217:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1788664482.457224:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2392:x1875550119522176:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664482.457254:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2392:x1875550119522176:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664482.457260:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1788664482.457273:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1788664482.457279:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2392:x1875550119522688:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664482.457301:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2392:x1875550119522688:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 22us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664482.457307:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1788664482.457317:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1788664482.457322:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2392:x1875550119522048:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664482.457343:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2392:x1875550119522048:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 20us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664482.457349:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1788664482.457359:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1788664482.457365:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2392:x1875550119522560:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664482.457387:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2392:x1875550119522560:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664482.457405:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1788664482.457672:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:3.0:1788664482.457688:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:2392:x1875550119521792:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664482.457719:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:2392:x1875550119521792:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664482.457725:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:3.0:1788664482.457739:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:3.0:1788664482.457745:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:2392:x1875550119522304:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664482.457764:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:2392:x1875550119522304:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 20us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664482.457797:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00080000:0.0:1788664482.459136:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788664482.459144:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664482.459147:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664482.459149:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788664482.494194:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664483.518244:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664484.543314:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788664484.632006:0:20170:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5a5d6a00 20000000:00000080:2.0:1788664484.632024:0:20170:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c43bc06c00 uarg=0000000000000000 20000000:01000000:2.0:1788664484.632064:0:20170:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788664484.632069:0:20170:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788664484.632074:0:20170:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788664484.634307:0:20171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788664484.634472:0:20170:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788664484.645103:0:20170:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788664484.645135:0:20170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c400030a00/0xcd11f61c1413edc2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.645154:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413ea57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413ea50 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.645162:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413ea65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413ea5e expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.645190:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c303957000/0xcd11f61c1413eaa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413ea9d expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.645197:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c40502b200/0xcd11f61c1413eb3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413eb37 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.645208:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ed52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d697 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.645215:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c303957200/0xcd11f61c1413ed91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d707 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.645222:0:20170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c400030a00/0xcd11f61c1413edc2 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.645269:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c303957200/0xcd11f61c1413ed91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d707 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.645284:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c303957200/0xcd11f61c1413ed91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d707 expref: 12 pid: 17136 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664484.645300:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875550140581248:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664484.645450:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ed52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d697 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.645459:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ed52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d697 expref: 12 pid: 17136 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664484.645468:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040afb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875550140581376:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664484.645532:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c40502b200/0xcd11f61c1413eb3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413eb37 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.645541:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c40502b200/0xcd11f61c1413eb3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413eb37 expref: 23 pid: 17138 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664484.645550:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875550140581504:0@lo:104: 00000100:00100000:1.0:1788664484.645592:0:20170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664484.645651:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c303957000/0xcd11f61c1413eaa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413ea9d expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.645662:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c303957000/0xcd11f61c1413eaa4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413ea9d expref: 23 pid: 17137 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664484.645670:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875550140581632:0@lo:104: 00000100:00100000:1.0:1788664484.645692:0:20170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664484.645727:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413ea65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413ea5e expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.645735:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413ea65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413ea5e expref: 23 pid: 17137 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664484.645742:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875550140581760:0@lo:104: 00000100:00100000:1.0:1788664484.645763:0:20170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664484.646058:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140581504 00000100:00100000:2.0:1788664484.646067:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140581504 00000100:00100000:2.0:1788664484.646105:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140581632 00000100:00100000:2.0:1788664484.646108:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140581632 00000100:00100000:2.0:1788664484.646119:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140581760 00000100:00100000:2.0:1788664484.646121:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140581760 00000100:00100000:2.0:1788664484.646134:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788664484.646143:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+5:20170:x1875550140581504:12345-0@lo:104: 00010000:00010000:2.0:1788664484.646156:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c303b84a00/0xcd11f61c1413eb37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413eb3e expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.646285:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413ea57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd11f61c1413ea50 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.646294:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413ea57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd11f61c1413ea50 expref: 23 pid: 17138 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664484.646316:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875550140581888:0@lo:104: 00010000:00010000:2.0:1788664484.647201:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664484.647220:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+5:20170:x1875550140581504:12345-0@lo:104: Request processed in 1076us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664484.647229:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788664484.647254:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788664484.647263:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+4:20170:x1875550140581632:12345-0@lo:104: 00010000:00010000:2.0:1788664484.647273:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413ea9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413eaa4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664484.647314:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788664484.647319:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+4:20170:x1875550140581632:12345-0@lo:104: Request processed in 59us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664484.647325:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788664484.647337:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788664484.647343:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+3:20170:x1875550140581760:12345-0@lo:104: 00010000:00010000:2.0:1788664484.647350:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413ea5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413ea65 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664484.647392:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788664484.647397:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+3:20170:x1875550140581760:12345-0@lo:104: Request processed in 55us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664484.647404:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788664484.648859:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788664484.648869:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c303b84a00/0xcd11f61c1413eb37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413eb3e expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.648880:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84a00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664484.648883:0:17131:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c303b84a00/0xcd11f61c1413eb37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413eb3e expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.648892:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c303b84a00/0xcd11f61c1413eb37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413eb3e expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664484.648900:0:17131:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c303b84a00/0xcd11f61c1413eb37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413eb3e expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664484.648919:0:17131:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664484.648965:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c303b84a00/0xcd11f61c1413eb37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413eb3e expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.648972:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664484.648994:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c303b84a00/0xcd11f61c1413eb37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413eb3e expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.649001:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c303b84a00/0xcd11f61c1413eb37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413eb3e expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.649014:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664484.649017:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413ea9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413eaa4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.649022:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664484.649024:0:17131:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413ea9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413eaa4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.649031:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413ea9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413eaa4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664484.649036:0:17131:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413ea9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413eaa4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664484.649041:0:17131:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664484.649052:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413ea9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413eaa4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.649057:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664484.649071:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413ea9d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413eaa4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.649077:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c303b84000/0xcd11f61c1413ea9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413eaa4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.649086:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664484.649089:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413ea5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413ea65 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.649094:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664484.649097:0:17131:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413ea5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413ea65 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.649104:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413ea5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413ea65 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664484.649109:0:17131:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413ea5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413ea65 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664484.649114:0:17131:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664484.649126:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413ea5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413ea65 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.649131:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664484.649145:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413ea5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413ea65 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.649151:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c303b84c00/0xcd11f61c1413ea5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413ea65 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.649170:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664484.649171:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664484.649173:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664484.649179:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664484.649749:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140582016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664484.650133:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664484.650187:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664484.650194:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140582144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664484.650217:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664484.650254:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140582272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664484.650275:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664484.650310:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140582016 00000100:00100000:0.0:1788664484.650318:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140582016 00010000:00010000:0.0:1788664484.650351:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c40502b200/0xcd11f61c1413eb3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413eb37 expref: 24 pid: 17138 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664484.650372:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140582144 00000100:00100000:0.0:1788664484.650385:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140582144 00010000:00010000:0.0:1788664484.650416:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c303957000/0xcd11f61c1413eaa4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413ea9d expref: 25 pid: 17137 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664484.650429:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140582272 00000100:00100000:0.0:1788664484.650432:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140582272 00010000:00010000:0.0:1788664484.650443:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413ea65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413ea5e expref: 26 pid: 17137 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664484.650456:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788664484.650464:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+26:3638:x1875550140582016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664484.650484:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664484.650490:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c40502b200/0xcd11f61c1413eb3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413eb37 expref: 26 pid: 17138 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.650501:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c40502b200/0xcd11f61c1413eb3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413eb37 expref: 26 pid: 17138 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.650518:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664484.650554:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+26:3638:x1875550140582016:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664484.650561:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788664484.650579:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788664484.650585:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+25:3638:x1875550140582144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664484.650592:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664484.650596:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c303957000/0xcd11f61c1413eaa4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413ea9d expref: 25 pid: 17137 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.650604:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c303957000/0xcd11f61c1413eaa4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413ea9d expref: 25 pid: 17137 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.650613:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664484.650698:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+25:3638:x1875550140582144:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664484.650704:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788664484.650717:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664484.650722:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:3636:x1875550140582272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664484.650729:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664484.650733:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413ea65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413ea5e expref: 24 pid: 17137 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.650748:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413ea65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413ea5e expref: 24 pid: 17137 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.650757:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664484.651063:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:3636:x1875550140582272:12345-0@lo:103:ldlm_bl.0 Request processed in 340us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664484.651070:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664484.651111:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140582272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664484.651136:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140582144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664484.651143:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140582016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788664484.651438:0:20170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664484.651508:0:20170:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4063830c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788664484.651525:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c40502b200/0xcd11f61c1413eb3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413eb37 expref: 23 pid: 17138 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664484.651538:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875550140581504:0@lo:104: 00010000:00010000:1.0:1788664484.651548:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303957000/0xcd11f61c1413eaa4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413ea9d expref: 22 pid: 17137 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664484.651556:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875550140581632:0@lo:104: 00010000:00010000:1.0:1788664484.651565:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e3200/0xcd11f61c1413ea65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413ea5e expref: 21 pid: 17137 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664484.651573:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875550140581760:0@lo:104: 00010000:00010000:2.0:1788664484.652082:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664484.655507:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875550140581248:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664484.655523:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040afb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875550140581376:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788664484.655592:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140581888 00000100:00100000:0.0:1788664484.655601:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140581888 00000100:00100000:1.0:1788664484.655712:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788664484.655722:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+3:20170:x1875550140581888:12345-0@lo:104: 00010000:00010000:1.0:1788664484.655740:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff93c40502ac00/0xcd11f61c1413ea50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413ea57 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.655845:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788664484.656264:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+3:20170:x1875550140581888:12345-0@lo:104: Request processed in 542us (4824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664484.656273:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788664484.656419:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664484.656426:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff93c40502ac00/0xcd11f61c1413ea50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd11f61c1413ea57 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.656434:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c40502ac00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1788664484.656438:0:17131:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff93c40502ac00/0xcd11f61c1413ea50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd11f61c1413ea57 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.656446:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff93c40502ac00/0xcd11f61c1413ea50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd11f61c1413ea57 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664484.656454:0:17131:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff93c40502ac00/0xcd11f61c1413ea50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd11f61c1413ea57 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664484.656459:0:17131:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664484.656515:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff93c40502ac00/0xcd11f61c1413ea50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413ea57 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.656522:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664484.656550:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff93c40502ac00/0xcd11f61c1413ea50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413ea57 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.656558:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff93c40502ac00/0xcd11f61c1413ea50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd11f61c1413ea57 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.656575:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664484.656577:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664484.656578:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664484.656588:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664484.656601:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140582400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664484.656667:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664484.656710:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140582400 00000100:00100000:0.0:1788664484.656715:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140582400 00010000:00010000:0.0:1788664484.656739:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413ea57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413ea50 expref: 21 pid: 17138 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664484.656763:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664484.656792:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:3636:x1875550140582400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664484.656804:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664484.656809:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413ea57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd11f61c1413ea50 expref: 21 pid: 17138 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.656818:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413ea57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd11f61c1413ea50 expref: 21 pid: 17138 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.656832:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664484.657079:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:3636:x1875550140582400:12345-0@lo:103:ldlm_bl.0 Request processed in 308us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664484.657086:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664484.657118:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3636:1875550140582400:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664484.657152:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303b85a00/0xcd11f61c1413ea57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd11f61c1413ea50 expref: 20 pid: 17138 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664484.657162:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875550140581888:0@lo:104: 00010000:00010000:0.0:1788664484.657188:0:20170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c400030a00/0xcd11f61c1413edc2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664484.662015:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664484.662090:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664484.662122:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119522816 00000100:00100000:0.0:1788664484.662131:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119522816 00010000:00010000:0.0:1788664484.662169:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c303957200/0xcd11f61c1413ed91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d707 expref: 13 pid: 17136 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664484.662199:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119522944 00000100:00100000:0.0:1788664484.662202:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119522944 00010000:00010000:0.0:1788664484.662213:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ed52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d697 expref: 14 pid: 17136 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664484.662227:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1788664484.662236:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3038bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a698de9a-812c-492b-8656-53dc2bcfa114+14:2391:x1875550119522816:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664484.662266:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664484.662272:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c303957200/0xcd11f61c1413ed91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d707 expref: 14 pid: 17136 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662295:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c303957200/0xcd11f61c1413ed91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d707 expref: 14 pid: 17136 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662312:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c303957200/0xcd11f61c1413ed91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d707 expref: 14 pid: 17136 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662328:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664484.662409:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3038bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a698de9a-812c-492b-8656-53dc2bcfa114+13:2391:x1875550119522816:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 173us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664484.662418:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1788664484.662463:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1788664484.662470:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a698de9a-812c-492b-8656-53dc2bcfa114+12:2391:x1875550119522944:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664484.662478:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664484.662483:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ed52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d697 expref: 12 pid: 17136 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662492:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ed52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d697 expref: 12 pid: 17136 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662502:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c4029e2a00/0xcd11f61c1413ed52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d697 expref: 12 pid: 17136 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662512:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c400030a00/0xcd11f61c1413edc2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662521:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c400030a00/0xcd11f61c1413edc2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662545:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c400030a00/0xcd11f61c1413edc2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662552:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c400030a00/0xcd11f61c1413edc2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662558:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c400030a00/0xcd11f61c1413edc2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662565:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c400030a00/0xcd11f61c1413edc2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662571:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030a00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664484.662575:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c400030a00/0xcd11f61c1413edc2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662583:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c400030a00/0xcd11f61c1413edc2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662597:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c400030a00/0xcd11f61c1413edc2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662608:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664484.662635:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a698de9a-812c-492b-8656-53dc2bcfa114+11:2391:x1875550119522944:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 159us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664484.662641:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00010000:00010000:0.0:1788664484.662670:0:20170:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c400030a00/0xcd11f61c1413edc2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662678:0:20170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c400030a00/0xcd11f61c1413edc2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664484.662690:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c400030a00/0xcd11f61c1413edc2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664485.581169:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664485.950307:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140582528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788664485.950400:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664485.950590:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140582528 00000100:00100000:1.0:1788664485.950599:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140582528 00000100:00100000:1.0:1788664485.950685:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788664485.950696:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140582528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788664485.950728:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788664485.951121:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664485.951327:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875550140582528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 632us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664485.951337:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788664485.951572:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1875550140582528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664486.046036:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664486.046109:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119523072 00000100:00100000:1.0:1788664486.046121:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119523072 00000100:00100000:1.0:1788664486.046188:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:1.0:1788664486.046200:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+11:14892:x1875550119523072:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664486.046218:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664486.046237:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c400030400/0xcd11f61c1413edc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d73f expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664486.046267:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c400030400/0xcd11f61c1413edc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d73f expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664486.046278:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c400030400/0xcd11f61c1413edc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d73f expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664486.046288:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400030400, rc 0) 00000100:00100000:1.0:1788664486.046347:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+12:14892:x1875550119523072:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 150us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664486.046355:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:0.0:1788664486.049614:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664486.049702:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119523200 00000100:00100000:1.0:1788664486.049713:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119523200 00000100:00100000:1.0:1788664486.049809:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 146 00000100:00100000:1.0:1788664486.049821:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c304106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+12:14892:x1875550119523200:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664486.049983:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c304106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+12:14892:x1875550119523200:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 163us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664486.049992:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 146 00000100:00100000:1.0:1788664486.055124:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664486.055296:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119523328 00000100:00100000:3.0:1788664486.055306:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119523328 00000100:00100000:3.0:1788664486.055357:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:3.0:1788664486.055380:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4199bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+12:14892:x1875550119523328:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664486.055545:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4199bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+12:14892:x1875550119523328:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 178us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664486.055554:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:1.0:1788664486.068887:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664486.069223:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119523456 00000100:00100000:2.0:1788664486.069235:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119523456 00000100:00100000:2.0:1788664486.069293:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:2.0:1788664486.069304:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4199bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+12:14892:x1875550119523456:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664486.069325:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664486.069354:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413edd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d746 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664486.069394:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413edd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d746 expref: 13 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664486.069415:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0d200/0xcd11f61c1413edd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d746 expref: 13 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664486.069424:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d200, rc 0) 00000100:00100000:2.0:1788664486.069485:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4199bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a698de9a-812c-492b-8656-53dc2bcfa114+13:14892:x1875550119523456:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 183us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664486.069492:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:1.0:1788664486.094843:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664486.095180:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119523584 00000100:00100000:2.0:1788664486.095191:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119523584 00000100:00100000:2.0:1788664486.095251:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:2.0:1788664486.095261:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4199bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+13:14892:x1875550119523584:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664486.095445:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4199bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+13:14892:x1875550119523584:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 184us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664486.095454:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:2.0:1788664486.114450:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664486.115124:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119523712 00000100:00100000:3.0:1788664486.115136:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119523712 00000100:00100000:3.0:1788664486.115190:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:3.0:1788664486.115200:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4199be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+13:14892:x1875550119523712:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664486.115345:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4199be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+13:14892:x1875550119523712:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 145us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664486.115360:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 150 10000000:01000000:0.0:1788664486.342852:0:17140:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1788664486.342860:0:17140:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c3039b7800 from 13 10000000:01000000:0.0:1788664486.342865:0:17140:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788664486.342910:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c42e7cd600/0xcd11f61c1413edd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664486.342921:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c42e7cd600/0xcd11f61c1413edd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664486.342934:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c42e7cd600/0xcd11f61c1413edd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664486.342962:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140582656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788664486.343032:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664486.343075:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42248df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788664486.343347:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140582656 00000100:00100000:3.0:1788664486.343356:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140582656 00000100:00100000:3.0:1788664486.343422:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788664486.343431:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+20:17140:x1875550140582656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664486.343445:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664486.343459:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c303b85600/0xcd11f61c1413edde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413edd7 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664486.343483:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c303b85600/0xcd11f61c1413edde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413edd7 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664486.343494:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c303b85600/0xcd11f61c1413edde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413edd7 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664486.343503:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85600, rc 0) 00000100:00100000:3.0:1788664486.343554:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:17140:x1875550140582656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664486.343561:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788664486.343657:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140582656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664486.343673:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c42e7cd600/0xcd11f61c1413edd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413edde expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664486.343683:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c42e7cd600/0xcd11f61c1413edd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413edde expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664486.343758:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140582784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664486.343822:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664486.343841:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4123c19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664486.344349:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140582784 00000100:00100000:3.0:1788664486.344356:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140582784 00000100:00100000:3.0:1788664486.344400:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788664486.344408:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:17140:x1875550140582784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664486.344520:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:17140:x1875550140582784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664486.344528:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788664486.344795:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140582784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664486.344833:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140582912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664486.344876:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664486.344895:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4123c19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664486.344958:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140582912 00000100:00100000:3.0:1788664486.344969:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140582912 00000100:00100000:3.0:1788664486.344996:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788664486.345002:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:17140:x1875550140582912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664486.345070:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:17140:x1875550140582912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664486.345076:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788664486.345154:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140582912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788664486.346975:0:20238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788664486.347219:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788664486.347241:0:17140:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788664486.347252:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c42e7cd600/0xcd11f61c1413edd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413edde expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664486.347263:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c42e7cd600/0xcd11f61c1413edd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413edde expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664486.347284:0:17140:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:3.0:1788664486.347287:0:17140:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c3041b2800 from 13 10000000:01000000:3.0:1788664486.347290:0:17140:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788664486.347326:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85800/0xcd11f61c1413ede5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664486.347335:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b85800/0xcd11f61c1413ede5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664486.347346:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b85800/0xcd11f61c1413ede5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664486.347379:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e889f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664486.347443:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664486.347488:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4063d3780 going to sleep for 11 seconds 00000100:00100000:2.0:1788664486.348445:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140583040 00000100:00100000:2.0:1788664486.348457:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140583040 00000100:00100000:2.0:1788664486.348584:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788664486.348596:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+21:17140:x1875550140583040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664486.348619:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664486.348635:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0d800/0xcd11f61c1413edec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413ede5 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664486.348663:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0d800/0xcd11f61c1413edec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413ede5 expref: 22 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664486.348673:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0d800/0xcd11f61c1413edec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413ede5 expref: 22 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664486.348682:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d800, rc 0) 00000100:00100000:2.0:1788664486.348749:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:17140:x1875550140583040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664486.348762:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788664486.348889:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e889f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664486.348912:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b85800/0xcd11f61c1413ede5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413edec expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664486.348921:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b85800/0xcd11f61c1413ede5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413edec expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664486.348989:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e889f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664486.349020:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664486.354480:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4063d3780 going to sleep for 11 seconds 00000100:00100000:2.0:1788664486.359002:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140583168 00000100:00100000:2.0:1788664486.359021:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140583168 00000100:00100000:2.0:1788664486.359085:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788664486.359094:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:17140:x1875550140583168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664486.359416:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:17140:x1875550140583168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (10394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664486.359424:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788664486.359524:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e889f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664486.359582:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e889f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664486.359643:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664486.359676:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4063d3780 going to sleep for 11 seconds 00000100:00100000:2.0:1788664486.359768:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140583296 00000100:00100000:2.0:1788664486.359796:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140583296 00000100:00100000:2.0:1788664486.359814:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788664486.359820:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:17140:x1875550140583296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664486.359887:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:17140:x1875550140583296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664486.359893:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788664486.359963:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e889f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788664486.361166:0:20239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788664486.368696:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788664486.368736:0:17140:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788664486.368747:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b85800/0xcd11f61c1413ede5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413edec expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664486.368760:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b85800/0xcd11f61c1413ede5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413edec expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664486.368794:0:17140:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788664486.368797:0:17140:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c42f768000 from 13 10000000:01000000:1.0:1788664486.368800:0:17140:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664486.368838:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400031a00/0xcd11f61c1413edf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664486.368846:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c400031a00/0xcd11f61c1413edf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664486.368858:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c400031a00/0xcd11f61c1413edf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664486.368885:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788664486.368965:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664486.369005:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406383240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664486.369077:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140583424 00000100:00100000:2.0:1788664486.369086:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140583424 00000100:00100000:2.0:1788664486.369138:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788664486.369148:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+22:17140:x1875550140583424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664486.369161:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664486.369174:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0dc00/0xcd11f61c1413edfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413edf3 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664486.369199:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0dc00/0xcd11f61c1413edfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413edf3 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664486.369209:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0dc00/0xcd11f61c1413edfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413edf3 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664486.369224:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0dc00, rc 0) 00000100:00100000:2.0:1788664486.369276:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:17140:x1875550140583424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664486.369284:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788664486.369414:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664486.369429:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c400031a00/0xcd11f61c1413edf3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413edfa expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664486.369438:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c400031a00/0xcd11f61c1413edf3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413edfa expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664486.369494:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664486.369522:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664486.369546:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406383240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664486.369585:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140583552 00000100:00100000:2.0:1788664486.369590:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140583552 00000100:00100000:2.0:1788664486.369621:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788664486.369628:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:17140:x1875550140583552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664486.369737:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:17140:x1875550140583552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664486.369744:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788664486.369882:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664486.369908:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664486.369948:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664486.369975:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406383240 going to sleep for 11 seconds 00000100:00100000:3.0:1788664486.370013:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140583680 00000100:00100000:3.0:1788664486.370017:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140583680 00000100:00100000:3.0:1788664486.370048:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788664486.370055:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:17140:x1875550140583680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664486.370136:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:17140:x1875550140583680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664486.370143:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788664486.370397:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788664486.371196:0:20240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788664486.371348:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788664486.371376:0:17140:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788664486.371385:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c400031a00/0xcd11f61c1413edf3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413edfa expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664486.371404:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c400031a00/0xcd11f61c1413edf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413edfa expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664486.371413:0:17140:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:3.0:1788664486.371416:0:17140:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93c43f740000 from 13 10000000:01000000:3.0:1788664486.371419:0:17140:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788664486.371444:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413ee01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664486.371451:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413ee01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664486.371460:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413ee01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664486.371478:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e889f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664486.371523:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664486.371559:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4063d3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664486.371619:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140583808 00000100:00100000:2.0:1788664486.371625:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140583808 00000100:00100000:2.0:1788664486.371662:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788664486.371671:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+23:17140:x1875550140583808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664486.371681:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664486.371693:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c402a0de00/0xcd11f61c1413ee08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd11f61c1413ee01 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664486.371712:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c402a0de00/0xcd11f61c1413ee08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd11f61c1413ee01 expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664486.371722:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c402a0de00/0xcd11f61c1413ee08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd11f61c1413ee01 expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664486.371729:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0de00, rc 0) 00000100:00100000:2.0:1788664486.371795:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:17140:x1875550140583808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664486.371802:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788664486.371885:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e889f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664486.371897:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413ee01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ee08 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664486.371905:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413ee01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd11f61c1413ee08 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664486.371954:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e889f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664486.371978:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664486.372006:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4063d3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664486.372047:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140583936 00000100:00100000:2.0:1788664486.372051:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140583936 00000100:00100000:2.0:1788664486.372080:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788664486.372086:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:17140:x1875550140583936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664486.372168:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:17140:x1875550140583936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664486.372176:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788664486.372235:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e889f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140583936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664486.372261:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e889f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140584064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664486.372297:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664486.372317:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4063d3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664486.372693:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140584064 00000100:00100000:2.0:1788664486.372697:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140584064 00000100:00100000:2.0:1788664486.372727:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788664486.372733:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:17140:x1875550140584064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664486.372860:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:17140:x1875550140584064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664486.372867:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788664486.373220:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e889f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:17140:1875550140584064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788664486.378992:0:20241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788664486.379051:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788664486.379071:0:17140:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788664486.379082:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413ee01 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ee08 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664486.379095:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff93c303b84200/0xcd11f61c1413ee01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd11f61c1413ee08 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664486.462140:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c42e889f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140584320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664486.462140:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140584192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664486.463480:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664486.463543:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140584704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788664486.463578:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664486.463596:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664486.463603:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140584576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788664486.463626:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664486.463757:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140584192 00000100:00100000:2.0:1788664486.463765:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140584192 00000100:00100000:3.0:1788664486.463807:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664486.463818:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140584576 00000100:00100000:2.0:1788664486.463821:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140584576 00000100:00100000:3.0:1788664486.463828:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140584832:0@lo:400:kworker.0 00000100:00100000:2.0:1788664486.463836:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788664486.463843:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140584192:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788664486.463879:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1788664486.463882:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788664486.463897:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140585344:0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.463919:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664486.463935:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788664486.463938:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140584192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664486.463946:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788664486.463949:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140584448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664486.463962:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788664486.463970:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664486.463980:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140584960:0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.463999:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664486.464014:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140585472:0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.464033:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664486.464075:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140584832 00000100:00100000:3.0:1788664486.464079:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140584832 00000100:00100000:3.0:1788664486.464115:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140584960 00000100:00100000:3.0:1788664486.464118:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140584960 00000100:00100000:3.0:1788664486.464137:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788664486.464144:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140584832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.464192:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140584832:12345-0@lo:400:kworker.0 Request processed in 49us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664486.464199:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788664486.464212:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788664486.464218:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140584960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.464244:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140584960:12345-0@lo:400:kworker.0 Request processed in 27us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664486.464249:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788664486.464266:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140585344 00000100:00100000:3.0:1788664486.464269:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140585344 00000100:00100000:3.0:1788664486.464292:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140585472 00000100:00100000:3.0:1788664486.464295:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140585472 00000100:00100000:3.0:1788664486.464312:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788664486.464332:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140585344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.464360:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875550140585344:12345-0@lo:400:kworker.0 Request processed in 43us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664486.464377:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788664486.464388:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788664486.464394:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140585472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.464419:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875550140585472:12345-0@lo:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664486.464424:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788664486.464446:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788664486.464451:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664486.464453:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788664486.464455:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664486.464493:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140584960:0@lo:400:kworker.0 00010000:00080000:3.0:1788664486.464515:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039ca300 x1875550140585472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664486.464525:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1875550140585472:0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.464533:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140584832:0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.464541:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1875550140585344:0@lo:400:kworker.0 00000100:00100000:1.0:1788664486.464623:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140584704 00000100:00100000:1.0:1788664486.464629:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140584704 00000100:00100000:1.0:1788664486.464662:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140584320 00000100:00100000:1.0:1788664486.464665:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140584320 00000100:00100000:1.0:1788664486.464675:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140584448 00000100:00100000:1.0:1788664486.464677:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140584448 00000100:00100000:1.0:1788664486.464688:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788664486.464694:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140584704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788664486.464722:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788664486.464760:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140584704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664486.464767:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788664486.464803:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788664486.464809:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140584320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664486.464818:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788664486.464849:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140584320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664486.464855:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788664486.464865:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788664486.464870:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140584448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664486.464879:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788664486.464899:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140584448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 30us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664486.464904:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788664486.465061:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140584448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664486.465075:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c42e889f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140584320:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788664486.465100:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664486.465257:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140585088:0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.465290:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664486.465310:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140584576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788664486.465337:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788664486.465382:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140585600:0@lo:400:kworker.0 00000100:00100000:2.0:1788664486.465386:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140584576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1419us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664486.465393:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788664486.465404:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664486.465419:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140585088 00000100:00100000:3.0:1788664486.465422:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788664486.465423:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140585088 00000100:00100000:3.0:1788664486.465428:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140585216:0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.465448:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664486.465460:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140585728:0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.465483:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664486.465502:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140585600 00000100:00100000:3.0:1788664486.465506:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140585600 00000100:00100000:3.0:1788664486.465528:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140585216 00000100:00100000:3.0:1788664486.465531:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140585216 00000100:00100000:3.0:1788664486.465539:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140585728 00000100:00100000:3.0:1788664486.465542:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140585728 00000100:00100000:3.0:1788664486.465553:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788664486.465558:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140585088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.465589:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875550140585088:12345-0@lo:400:kworker.0 Request processed in 30us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664486.465606:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788664486.465693:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788664486.465700:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140585600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.465728:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875550140585600:12345-0@lo:400:kworker.0 Request processed in 29us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664486.465733:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788664486.465743:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788664486.465748:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140585216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.465787:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875550140585216:12345-0@lo:400:kworker.0 Request processed in 23us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664486.465793:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788664486.465804:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788664486.465810:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140585728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.465835:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875550140585728:12345-0@lo:400:kworker.0 Request processed in 26us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664486.465841:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788664486.465855:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788664486.465857:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664486.466556:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875550140585216:0@lo:400:kworker.0 00010000:00080000:3.0:1788664486.466573:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039c9500 x1875550140585728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664486.466582:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1875550140585728:0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.466590:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875550140585088:0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.466598:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1875550140585600:0@lo:400:kworker.0 00000100:00100000:3.0:1788664486.466861:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140584576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788664486.466894:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140584704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788664486.466909:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140584192:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788664486.592398:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788664487.358462:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788664487.590148:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664487.590252:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664487.590283:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664487.590319:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664487.590342:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664487.590371:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664487.590400:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664487.590451:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664487.590476:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664487.590502:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119524096 00000100:00100000:1.0:1788664487.590512:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119524096 00000100:00100000:1.0:1788664487.590561:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119524608 00000100:00100000:1.0:1788664487.590564:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119524608 00000100:00100000:1.0:1788664487.590578:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119523968 00000100:00100000:1.0:1788664487.590580:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119523968 00000100:00100000:1.0:1788664487.590654:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119524480 00000100:00100000:1.0:1788664487.590657:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119524480 00000100:00100000:1.0:1788664487.590673:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:1.0:1788664487.590683:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2393:x1875550119524096:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664487.590802:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2393:x1875550119524096:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 119us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664487.590810:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:1.0:1788664487.590827:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:1.0:1788664487.590834:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2393:x1875550119524608:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664487.590861:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2393:x1875550119524608:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664487.590867:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:1.0:1788664487.590878:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:1.0:1788664487.590884:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:2393:x1875550119523968:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664487.590906:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:2393:x1875550119523968:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 22us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664487.590912:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:1.0:1788664487.590935:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1788664487.590949:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:2393:x1875550119524480:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664487.590986:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:2393:x1875550119524480:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664487.590991:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:3.0:1788664487.594319:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119524352 00000100:00100000:3.0:1788664487.594335:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119524352 00000100:00100000:3.0:1788664487.594410:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119524864 00000100:00100000:3.0:1788664487.594414:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119524864 00000100:00100000:3.0:1788664487.594428:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119524224 00000100:00100000:3.0:1788664487.594432:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119524224 00000100:00100000:3.0:1788664487.594454:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119524736 00000100:00100000:3.0:1788664487.594458:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119524736 00000100:00100000:3.0:1788664487.594478:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1788664487.594488:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2393:x1875550119524352:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664487.594580:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2393:x1875550119524352:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 93us (4295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664487.594588:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1788664487.594606:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788664487.594613:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2393:x1875550119524864:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664487.595158:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2393:x1875550119524864:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 543us (4813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664487.595166:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788664487.595195:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788664487.595203:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2393:x1875550119524224:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664487.595228:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2393:x1875550119524224:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (4836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664487.595248:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788664487.595261:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788664487.595267:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2393:x1875550119524736:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788664487.595291:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2393:x1875550119524736:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (4815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664487.595297:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00080000:3.0:1788664487.595323:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664487.595328:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788664487.595330:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664487.595333:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664487.599161:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119523840 00000100:00100000:2.0:1788664487.599177:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119523840 00000100:00100000:2.0:1788664487.599262:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:2.0:1788664487.599272:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+13:2393:x1875550119523840:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664487.599368:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a698de9a-812c-492b-8656-53dc2bcfa114+13:2393:x1875550119523840:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 97us (9229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664487.599377:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 163 00010000:00010000:0.0:1788664487.614392:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664488.472809:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664488.473102:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119524992 00000100:00100000:2.0:1788664488.473113:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119524992 00000100:00100000:2.0:1788664488.473189:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:2.0:1788664488.473201:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:15561:x1875550119524992:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664488.473224:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664488.473268:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413ee0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d74d expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473344:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ee16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473368:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ee16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473383:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ee16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473399:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413ee1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473405:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413ee1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473412:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413ee1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473588:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413ee24 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473598:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413ee24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473605:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413ee24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664488.473641:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788664488.473645:0:17143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664488.473679:0:17143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413ee24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473701:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ee16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473708:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ee16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473714:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ee16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473720:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664488.473724:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ee16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473731:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ee16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473742:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6600) 00010000:00010000:2.0:1788664488.473751:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664488.473756:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ee16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473762:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ee16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473815:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413ee1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473822:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413ee1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473828:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413ee1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473839:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0d000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664488.473843:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413ee1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473848:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413ee1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473856:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93c422270e00) 00010000:00010000:2.0:1788664488.473859:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664488.473862:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413ee1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.473876:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413ee1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.474075:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413ee0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d74d expref: 8 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.474102:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d600/0xcd11f61c1413ee24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d74d expref: 7 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.474110:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c422270700) 00010000:00010000:2.0:1788664488.474112:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664488.474115:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d600, rc 0) 00000100:00100000:2.0:1788664488.474196:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+7:15561:x1875550119524992:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 997us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664488.474204:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1788664488.490549:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664488.491065:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119525120 00000100:00100000:3.0:1788664488.491077:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119525120 00000100:00100000:3.0:1788664488.491145:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1788664488.491156:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+7:15561:x1875550119525120:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788664488.491251:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+7:15561:x1875550119525120:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 Request processed in 97us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664488.491260:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1788664488.500418:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664488.500523:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119525376 00000100:00100000:1.0:1788664488.500534:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119525376 00000100:00100000:1.0:1788664488.500643:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:1.0:1788664488.500655:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+7:15561:x1875550119525376:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664488.500677:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664488.500698:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee2b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d754 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.500813:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413ee32 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.500837:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413ee32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.500849:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413ee32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502003:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413ee39 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502018:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413ee39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502046:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413ee39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502492:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031800/0xcd11f61c1413ee40 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502502:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031800/0xcd11f61c1413ee40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502510:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031800/0xcd11f61c1413ee40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664488.502521:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788664488.502671:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413ee32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502679:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413ee32 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502686:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413ee32 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502692:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664488.502697:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413ee32 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502704:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413ee32 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502715:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c422270700) 00010000:00010000:1.0:1788664488.502718:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664488.502729:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413ee32 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502736:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413ee32 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502749:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413ee39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502755:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413ee39 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502760:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413ee39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502765:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400031600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664488.502767:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413ee39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.502821:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413ee39 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.507018:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93c3027e6300) 00010000:00010000:1.0:1788664488.507028:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664488.507039:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413ee39 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.507050:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413ee39 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.513844:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee2b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d754 expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.513892:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031800/0xcd11f61c1413ee40 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d754 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.513902:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c3027e6c00) 00010000:00010000:1.0:1788664488.513906:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664488.513909:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400031800, rc 0) 00000100:00100000:1.0:1788664488.514590:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+9:15561:x1875550119525376:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 13933us (14178us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788664488.514601:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:1.0:1788664488.536291:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664488.536424:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119525504 00000100:00100000:2.0:1788664488.536435:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119525504 00000100:00100000:2.0:1788664488.536557:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:2.0:1788664488.536569:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+9:15561:x1875550119525504:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788664488.536683:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+9:15561:x1875550119525504:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 117us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664488.536691:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:2.0:1788664488.568583:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664488.568729:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119525632 00000100:00100000:3.0:1788664488.568740:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119525632 00000100:00100000:3.0:1788664488.568909:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:3.0:1788664488.568920:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:15561:x1875550119525632:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788664488.572094:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664488.572271:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119525760 00000100:00100000:3.0:1788664488.572407:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119525760 00000100:00100000:3.0:1788664488.572469:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788664488.572480:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+9:15567:x1875550119525760:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664488.572529:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664488.572563:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85a00/0xcd11f61c1413ee4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d75b expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.572869:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413ee55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.572893:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413ee55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.572907:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413ee55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788664488.578817:0:18960:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 9843us 00010000:00010000:3.0:1788664488.583577:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413ee5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583600:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413ee5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583615:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413ee5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583666:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413ee55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583674:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413ee55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583680:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413ee55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583686:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84c00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664488.583699:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413ee55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583707:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413ee55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583721:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6600) 00010000:00010000:3.0:1788664488.583724:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664488.583730:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413ee55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583736:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413ee55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583747:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413ee5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583753:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413ee5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583759:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413ee5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583766:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664488.583788:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413ee5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583796:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413ee5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583804:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c42231c900) 00010000:00010000:3.0:1788664488.583807:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664488.583816:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413ee5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583823:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413ee5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583876:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85a00/0xcd11f61c1413ee4e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d75b expref: 10 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.583888:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6600) 00010000:00010000:3.0:1788664488.583891:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664488.584585:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85a00/0xcd11f61c1413ee4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d75b expref: 10 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.584599:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85a00, rc 0) 00000100:00100000:3.0:1788664488.584679:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+9:15567:x1875550119525760:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 12198us (12598us total) trans 0 rc 301/301 00000100:00100000:3.0:1788664488.584690:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:2.0:1788664488.588395:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664488.588491:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119525888 00000100:00100000:3.0:1788664488.588502:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119525888 00000100:00100000:3.0:1788664488.588563:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1788664488.588575:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+9:15567:x1875550119525888:12345-192.168.203.52@tcp:700:lfs.0 00000100:00100000:3.0:1788664488.588653:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+9:15567:x1875550119525888:12345-192.168.203.52@tcp:700:lfs.0 Request processed in 80us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664488.588662:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1788664488.614920:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664488.614964:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119526144 00000100:00100000:1.0:1788664488.614975:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119526144 00000100:00100000:1.0:1788664488.615031:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1788664488.615041:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+9:15567:x1875550119526144:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:1.0:1788664488.615107:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664488.615133:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413ed7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d6c8 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.615153:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6600) 00010000:00010000:1.0:1788664488.615158:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664488.615214:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.615228:0:17145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413edbb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d738 expref: 5 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.615250:0:17145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee63 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.615292:0:17145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413edbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d738 expref: 5 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.615307:0:17145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413edbb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d738 expref: 5 pid: 18960 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664488.615323:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3040ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1875550140585856:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664488.615409:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406383e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664488.620402:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:15561:x1875550119525632:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 51472us (51820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664488.620416:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:0.0:1788664488.620589:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664488.620614:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119526272 00000100:00100000:0.0:1788664488.620622:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119526272 00010000:00010000:0.0:1788664488.620656:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413edbb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d738 expref: 6 pid: 18960 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664488.620689:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:0.0:1788664488.620699:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:2390:x1875550119526272:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664488.620716:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664488.620723:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413edbb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d738 expref: 6 pid: 18960 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.620736:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413edbb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d738 expref: 6 pid: 18960 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.620759:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6600) 00010000:00010000:0.0:1788664488.620765:0:17130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.620798:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.620807:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee63 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.620829:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664488.620875:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:2390:x1875550119526272:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 177us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664488.620884:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00010000:00010000:0.0:1788664488.620944:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413edbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d738 expref: 5 pid: 18960 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664488.620961:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3040ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1875550140585856:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788664488.620984:0:17145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.620994:0:17145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.621000:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.621024:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cce00/0xcd11f61c1413ee6a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.621035:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cce00/0xcd11f61c1413ee6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.621043:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cce00/0xcd11f61c1413ee6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.623184:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd200/0xcd11f61c1413ee71 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.623204:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd200/0xcd11f61c1413ee71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.623215:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd200/0xcd11f61c1413ee71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664488.623245:0:17145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011c8d315 reply state 000000005f479d3c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd200/0xcd11f61c1413ee71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.623256:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd200/0xcd11f61c1413ee71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.623264:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c303884900) 00010000:00010000:0.0:1788664488.623267:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788664488.623271:0:17145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788664488.623277:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788664488.623285:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.623292:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee63 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.623300:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee63 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.623306:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030a00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:0.0:1788664488.623310:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee63 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.623318:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee63 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.623338:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6600) 00010000:00010000:0.0:1788664488.623342:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664488.623345:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee63 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.623371:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ee63 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664488.623390:0:17145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011c8d315 reply state 000000005f479d3c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cce00/0xcd11f61c1413ee6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.623400:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cce00/0xcd11f61c1413ee6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.623406:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c303884800) 00010000:00010000:0.0:1788664488.623409:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788664488.623411:0:17145:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788664488.623548:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+10:15567:x1875550119526144:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 8504us (8642us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788664488.623557:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00010000:00010000:0.0:1788664488.638166:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664488.794018:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664488.794143:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119526400 00000100:00100000:1.0:1788664488.794153:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119526400 00000100:00100000:1.0:1788664488.794221:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:1.0:1788664488.794231:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e88a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+10:15575:x1875550119526400:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:1.0:1788664488.794261:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664488.794285:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413ee78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d762 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.794373:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413ee7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.794388:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413ee7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.794400:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413ee7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664488.794457:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788664488.794461:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664488.794496:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413ee7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.794520:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413ee78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d762 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.794539:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030800/0xcd11f61c1413ee7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d762 expref: 11 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.794548:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6300) 00010000:00010000:1.0:1788664488.794551:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788664488.794555:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400030800, rc 0) 00000100:00100000:1.0:1788664488.794627:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e88a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+11:15575:x1875550119526400:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 397us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664488.794634:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:2.0:1788664488.854748:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664488.854936:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119526528 00000100:00100000:0.0:1788664488.854948:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119526528 00000100:00100000:0.0:1788664488.855049:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:0.0:1788664488.855060:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:15576:x1875550119526528:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788664488.855081:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664488.855102:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cc600/0xcd11f61c1413ee86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d769 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.855168:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cc000/0xcd11f61c1413ee8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.855182:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cc000/0xcd11f61c1413ee8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.855206:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cc000/0xcd11f61c1413ee8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664488.855250:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788664488.855254:0:18960:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788664488.855273:0:18960:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cc000/0xcd11f61c1413ee8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.855296:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cc600/0xcd11f61c1413ee86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d769 expref: 7 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.855315:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cc000/0xcd11f61c1413ee8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d769 expref: 6 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.855323:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6300) 00010000:00010000:0.0:1788664488.855326:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664488.855343:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c42e7cc000, rc 0) 00000100:00100000:0.0:1788664488.855422:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:15576:x1875550119526528:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 364us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664488.855430:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:1.0:1788664488.862857:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664488.863018:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119526656 00000100:00100000:2.0:1788664488.863031:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119526656 00000100:00100000:2.0:1788664488.863096:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:2.0:1788664488.863107:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3040ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:15576:x1875550119526656:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664488.863133:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664488.863168:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ee94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d770 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863231:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ee9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863246:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ee9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863258:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ee9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863269:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eea2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863276:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863282:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863364:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413eea9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863373:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413eea9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863379:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413eea9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664488.863430:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788664488.863435:0:17143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664488.863456:0:17143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413eea9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863475:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ee9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863482:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ee9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863490:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ee9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863497:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0da00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664488.863501:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ee9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863514:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ee9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863527:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6300) 00010000:00010000:2.0:1788664488.863530:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664488.863536:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ee9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863542:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ee9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863554:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863560:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eea2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863564:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eea2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863576:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664488.863579:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eea2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863586:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eea2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863594:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c303884800) 00010000:00010000:2.0:1788664488.863596:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664488.863599:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eea2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863604:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eea2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863631:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ee94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d770 expref: 8 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863644:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413eea9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d770 expref: 7 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.863652:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c303884900) 00010000:00010000:2.0:1788664488.863654:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664488.863657:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0ce00, rc 0) 00000100:00100000:2.0:1788664488.864076:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3040ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+7:15576:x1875550119526656:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 968us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664488.864085:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:0.0:1788664488.874878:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664488.875210:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119526784 00000100:00100000:3.0:1788664488.875224:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119526784 00000100:00100000:3.0:1788664488.875309:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1788664488.875321:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:15576:x1875550119526784:12345-192.168.203.52@tcp:900:lfs.0 00000100:00100000:3.0:1788664488.875414:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:15576:x1875550119526784:12345-192.168.203.52@tcp:900:lfs.0 Request processed in 96us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664488.875422:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788664488.886397:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664488.886481:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119527040 00000100:00100000:1.0:1788664488.886493:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119527040 00000100:00100000:1.0:1788664488.886557:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:1.0:1788664488.886568:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24b2763c-9677-4c1d-9630-d8d0d4c5653c+7:15576:x1875550119527040:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788664488.886602:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664488.886626:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413eeb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d777 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664488.886735:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788664488.887075:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413eeb0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d777 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.887092:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6300) 00010000:00010000:1.0:1788664488.887095:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788664488.887100:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413eeb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d777 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.887114:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400030c00, rc 0) 00000100:00100000:1.0:1788664488.887179:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24b2763c-9677-4c1d-9630-d8d0d4c5653c+8:15576:x1875550119527040:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 613us (792us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788664488.887187:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:1.0:1788664488.896028:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664488.896303:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119527296 00000100:00100000:0.0:1788664488.896315:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119527296 00000100:00100000:0.0:1788664488.896388:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1788664488.896399:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+8:15576:x1875550119527296:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:0.0:1788664488.896454:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664488.896493:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413eea9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d770 expref: 8 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.896514:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c303884900) 00010000:00010000:0.0:1788664488.896519:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664488.896541:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413eebe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.896554:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413eebe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.896564:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413eebe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664488.898292:0:17144:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025ad9725 reply state 0000000078ed3299 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413eebe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.898326:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413eebe lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.898335:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c303884900) 00010000:00010000:2.0:1788664488.898338:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788664488.898341:0:17144:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788664488.898358:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788664488.898458:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+9:15576:x1875550119527296:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 2059us (2438us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788664488.898467:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1788664488.907596:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664488.907694:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119527552 00000100:00100000:3.0:1788664488.907707:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119527552 00000100:00100000:3.0:1788664488.907810:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1788664488.907831:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+9:15576:x1875550119527552:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788664488.908111:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+10:15576:x1875550119527552:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 289us (523us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788664488.908121:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1788664488.922279:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664488.922523:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119527808 00000100:00100000:3.0:1788664488.922536:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119527808 00000100:00100000:3.0:1788664488.922611:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:3.0:1788664488.922628:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+10:15576:x1875550119527808:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788664488.922654:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664488.922674:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85a00/0xcd11f61c1413eec5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d77e expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.922752:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413eecc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.922767:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413eecc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.922835:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413eecc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.922862:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413eed3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.922871:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413eed3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.922877:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413eed3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664488.922994:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788664488.925898:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413eecc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.926226:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413eecc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.926234:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413eecc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.926241:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664488.926245:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413eecc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.926253:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413eecc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.926270:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6300) 00010000:00010000:3.0:1788664488.926274:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664488.926279:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413eecc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.926303:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413eecc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.926319:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413eed3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.926325:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413eed3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.926331:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413eed3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.926336:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84c00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664488.926340:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413eed3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.926354:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413eed3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.926362:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c303884800) 00010000:00010000:3.0:1788664488.926365:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664488.926376:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413eed3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.926382:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84c00/0xcd11f61c1413eed3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.927199:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85a00/0xcd11f61c1413eec5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d77e expref: 12 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.927215:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6300) 00010000:00010000:2.0:1788664488.927218:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664488.927222:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b85a00/0xcd11f61c1413eec5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d77e expref: 12 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.927236:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b85a00, rc 0) 00000100:00100000:2.0:1788664488.927326:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+11:15576:x1875550119527808:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 4699us (5055us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788664488.927336:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1788664488.941879:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664488.942444:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119527936 00000100:00100000:2.0:1788664488.942457:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119527936 00000100:00100000:2.0:1788664488.942522:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:2.0:1788664488.942533:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+11:15576:x1875550119527936:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664488.942562:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664488.942596:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413eee1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d785 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.942691:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eee8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.942707:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.942718:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664488.942743:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788664488.942747:0:17143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664488.942767:0:17143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.942816:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413eee1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d785 expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.943343:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eee8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d785 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.943361:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c303884900) 00010000:00010000:2.0:1788664488.943364:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664488.943375:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c200, rc 0) 00000100:00100000:2.0:1788664488.943440:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+12:15576:x1875550119527936:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 908us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664488.943447:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788664488.947213:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664488.947315:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119528064 00000100:00100000:3.0:1788664488.947327:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119528064 00000100:00100000:3.0:1788664488.947403:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1788664488.947696:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+12:15576:x1875550119528064:12345-192.168.203.52@tcp:37:lfs.0 00000100:00100000:3.0:1788664488.952660:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24b2763c-9677-4c1d-9630-d8d0d4c5653c+12:15576:x1875550119528064:12345-192.168.203.52@tcp:37:lfs.0 Request processed in 5237us (5445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664488.952674:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1788664488.956870:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664488.957008:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119528320 00000100:00100000:2.0:1788664488.957031:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119528320 00000100:00100000:2.0:1788664488.957102:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1788664488.957115:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43064bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+12:15576:x1875550119528320:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788664488.957362:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43064bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+13:15576:x1875550119528320:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 250us (501us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788664488.957381:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1788664489.069675:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664489.070411:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119528448 00000100:00100000:1.0:1788664489.070424:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119528448 00000100:00080000:3.0:1788664489.070491:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664489.070506:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:1.0:1788664489.070519:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+11:15582:x1875550119528448:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788664489.070540:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664489.070561:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413eeef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d78c expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070626:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413eef6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070642:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413eef6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070672:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413eef6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070687:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413eefd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070695:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413eefd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070702:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413eefd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070827:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413ef04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070838:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413ef04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070844:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413ef04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664489.070876:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788664489.070880:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664489.070915:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413ef04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070927:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413eef6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070934:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413eef6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070951:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413eef6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070957:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400031600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664489.070961:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413eef6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070968:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413eef6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070980:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6300) 00010000:00010000:1.0:1788664489.070984:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664489.070989:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413eef6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.070995:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413eef6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.071010:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413eefd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.071016:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413eefd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.071021:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413eefd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.071027:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030a00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664489.071030:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413eefd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.071045:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413eefd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.071054:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c303884800) 00010000:00010000:1.0:1788664489.071056:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664489.071060:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413eefd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.071064:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413eefd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.071092:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413eeef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d78c expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.071104:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030c00/0xcd11f61c1413ef04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d78c expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.071111:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c303884900) 00010000:00010000:1.0:1788664489.071114:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788664489.071116:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400030c00, rc 0) 00000100:00100000:1.0:1788664489.071187:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+12:15582:x1875550119528448:12345-192.168.203.52@tcp:101:bash.0 Request processed in 672us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664489.071195:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:0.0:1788664489.084817:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664489.084918:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119528576 00000100:00100000:3.0:1788664489.084928:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119528576 00000100:00100000:3.0:1788664489.085007:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1788664489.085019:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:15582:x1875550119528576:12345-192.168.203.52@tcp:900:bash.0 00000100:00100000:3.0:1788664489.085111:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:15582:x1875550119528576:12345-192.168.203.52@tcp:900:bash.0 Request processed in 95us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664489.085119:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00080000:0.0:1788664489.085246:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788664489.086584:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788664489.093856:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664489.093985:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119528832 00000100:00100000:2.0:1788664489.093996:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119528832 00000100:00100000:2.0:1788664489.094063:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:2.0:1788664489.094074:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+12:15582:x1875550119528832:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788664489.094098:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664489.094119:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef0b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d793 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.094228:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef12 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.094254:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eee8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d785 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.094263:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef12 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.094299:0:17144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eee8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d785 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.094313:0:17144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eee8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d785 expref: 12 pid: 17143 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664489.094355:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1875550140585984:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664489.094433:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c408472a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664489.100055:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664489.100558:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1875550140585984:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788664489.100590:0:17144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef12 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664489.100747:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119528960 00000100:00100000:3.0:1788664489.100756:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119528960 00010000:00010000:3.0:1788664489.100921:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eee8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d785 expref: 13 pid: 17143 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664489.100961:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1788664489.100972:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+13:2390:x1875550119528960:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664489.100990:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664489.100997:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eee8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d785 expref: 13 pid: 17143 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664489.101011:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eee8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d785 expref: 13 pid: 17143 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664489.101052:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413eee8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d785 expref: 13 pid: 17143 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664489.101068:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c303884900) 00010000:00010000:3.0:1788664489.101073:0:17128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef12 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664489.101083:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef12 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664489.101091:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef12 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664489.101119:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664489.101176:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+12:2390:x1875550119528960:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 206us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664489.101195:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00010000:00010000:2.0:1788664489.102009:0:17144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef12 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102022:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef12 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102049:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413ef19 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102061:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413ef19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102069:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413ef19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102582:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ef20 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102593:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ef20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102612:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ef20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664489.102634:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788664489.102664:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef12 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102670:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef12 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102676:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef12 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102682:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0da00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664489.102686:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef12 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102693:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef12 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102704:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c303884900) 00010000:00010000:2.0:1788664489.102707:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664489.102710:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef12 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102715:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef12 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664489.102726:0:17144:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055c4027d reply state 000000008aaca5d8 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413ef19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102735:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413ef19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102749:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93c422270e00) 00010000:00010000:2.0:1788664489.102752:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788664489.102755:0:17144:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788664489.102837:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef0b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d793 expref: 15 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102852:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ef20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d793 expref: 14 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.102861:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:2.0:1788664489.102863:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788664489.102865:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c600, rc 0) 00000100:00100000:2.0:1788664489.103414:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+15:15582:x1875550119528832:12345-192.168.203.52@tcp:101:bash.0 Request processed in 9337us (9562us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788664489.103424:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00080000:0.0:1788664489.107099:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664489.123102:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664489.124012:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119529088 00000100:00100000:0.0:1788664489.124025:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119529088 00000100:00100000:0.0:1788664489.124085:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:0.0:1788664489.124094:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+15:15582:x1875550119529088:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788664489.124118:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664489.124138:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cca00/0xcd11f61c1413ef2e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d79a expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664489.124209:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cdc00/0xcd11f61c1413ef35 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664489.124241:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cdc00/0xcd11f61c1413ef35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664489.124252:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cdc00/0xcd11f61c1413ef35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664489.124310:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788664489.124315:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788664489.124336:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cdc00/0xcd11f61c1413ef35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664489.124356:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cdc00/0xcd11f61c1413ef35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664489.124381:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cca00/0xcd11f61c1413ef2e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d79a expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664489.124397:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cdc00/0xcd11f61c1413ef35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d79a expref: 16 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664489.124405:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:0.0:1788664489.124407:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664489.124411:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c42e7cdc00, rc 0) 00000100:00100000:0.0:1788664489.124478:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+16:15582:x1875550119529088:12345-192.168.203.52@tcp:101:bash.0 Request processed in 385us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664489.124486:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:2.0:1788664489.135720:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664489.135810:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119529344 00000100:00100000:3.0:1788664489.135821:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119529344 00000100:00100000:3.0:1788664489.135878:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1788664489.135889:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+16:15582:x1875550119529344:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:3.0:1788664489.136207:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+17:15582:x1875550119529344:12345-192.168.203.52@tcp:35:bash.0 Request processed in 319us (496us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788664489.136215:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1788664489.305969:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664489.306078:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119529600 00000100:00100000:1.0:1788664489.306089:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119529600 00000100:00100000:1.0:1788664489.306167:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1788664489.306178:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42e889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+17:15592:x1875550119529600:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788664489.306205:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664489.306226:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413ef3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d7a1 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664489.306320:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788664489.306428:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413ef3c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7a1 expref: 19 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.306444:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6300) 00010000:00010000:1.0:1788664489.306447:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788664489.306452:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413ef3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7a1 expref: 19 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.306466:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400031600, rc 0) 00000100:00100000:1.0:1788664489.306535:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42e889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+18:15592:x1875550119529600:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 359us (577us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788664489.306543:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1788664489.309116:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664489.309194:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119529856 00000100:00100000:3.0:1788664489.309205:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119529856 00000100:00100000:3.0:1788664489.309286:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1788664489.309297:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+18:15592:x1875550119529856:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788664489.309519:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+19:15592:x1875550119529856:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 223us (412us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788664489.309527:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788664489.391843:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664489.392407:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119530112 00000100:00100000:1.0:1788664489.392419:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119530112 00000100:00100000:1.0:1788664489.392482:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:1.0:1788664489.392494:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+19:15595:x1875550119530112:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788664489.392517:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664489.392539:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413ef4a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d7a8 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.392674:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413ef51 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.392689:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413ef51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.392701:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413ef51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664489.392712:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788664489.392848:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413ef4a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7a8 expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.392867:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413ef51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7a8 expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.392876:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664489.392879:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788664489.392883:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c400031400, rc 0) 00000100:00100000:1.0:1788664489.392964:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+21:15595:x1875550119530112:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 472us (1129us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788664489.392972:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:1.0:1788664489.402287:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664489.402385:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119530240 00000100:00100000:2.0:1788664489.402396:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119530240 00000100:00100000:2.0:1788664489.402459:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:2.0:1788664489.402470:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+21:15595:x1875550119530240:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1788664489.402534:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef5f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.402550:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.402560:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.402617:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.402623:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef5f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.402629:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.402635:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664489.402639:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.402647:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.402659:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:2.0:1788664489.402662:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664489.402666:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef5f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.402672:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664489.402736:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+21:15595:x1875550119530240:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 268us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664489.402743:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:3.0:1788664489.406101:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664489.406326:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119530496 00000100:00100000:2.0:1788664489.406337:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119530496 00000100:00100000:2.0:1788664489.406399:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788664489.406422:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+21:15595:x1875550119530496:12345-192.168.203.52@tcp:35:lfs.0 00000040:00080000:0.0:1788664489.406646:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788664489.406649:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+22:15595:x1875550119530496:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 229us (557us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788664489.406657:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788664489.412625:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664489.414744:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119530624 00000100:00100000:2.0:1788664489.414757:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119530624 00000100:00100000:2.0:1788664489.414855:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1788664489.414865:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+22:2391:x1875550119530624:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664489.414882:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664489.414922:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413ef51 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7a8 expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.414943:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:2.0:1788664489.414948:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664489.415052:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+21:2391:x1875550119530624:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 188us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664489.415059:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00010000:00010000:2.0:1788664489.662271:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664489.788192:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664489.794042:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119530880 00000100:00100000:0.0:1788664489.794337:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119530880 00000100:00100000:0.0:1788664489.794444:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:0.0:1788664489.794456:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+21:15626:x1875550119530880:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:0.0:1788664489.794487:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664489.794510:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7ccc00/0xcd11f61c1413ef66 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d7af expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664489.794660:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cde00/0xcd11f61c1413ef6d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664489.794677:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cde00/0xcd11f61c1413ef6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664489.794689:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cde00/0xcd11f61c1413ef6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664489.794702:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788664489.797316:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7ccc00/0xcd11f61c1413ef66 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7af expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664489.797358:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cde00/0xcd11f61c1413ef6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7af expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664489.797368:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:0.0:1788664489.797371:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664489.797374:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c42e7cde00, rc 0) 00000100:00100000:0.0:1788664489.797470:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+23:15626:x1875550119530880:12345-192.168.203.52@tcp:101:cat.0 Request processed in 3014us (9286us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788664489.797497:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:1.0:1788664489.805758:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664489.805907:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119531136 00000100:00100000:2.0:1788664489.805918:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119531136 00000100:00100000:2.0:1788664489.805980:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1788664489.805991:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+23:15626:x1875550119531136:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:2.0:1788664489.806620:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+24:15626:x1875550119531136:12345-192.168.203.52@tcp:35:cat.0 Request processed in 628us (867us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788664489.806629:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1788664489.809305:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664489.809449:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119531264 00000100:00100000:1.0:1788664489.809460:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119531264 00000100:00100000:1.0:1788664489.809526:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1788664489.809543:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3035a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+24:2390:x1875550119531264:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664489.809561:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664489.809585:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cde00/0xcd11f61c1413ef6d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7af expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.809612:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664489.809616:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664489.809669:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3035a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+23:2390:x1875550119531264:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 129us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664489.809676:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1788664489.959379:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664489.959468:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119531520 00000100:00100000:2.0:1788664489.959479:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119531520 00000100:00100000:2.0:1788664489.959537:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:2.0:1788664489.959547:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+23:15633:x1875550119531520:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:2.0:1788664489.959573:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664489.959593:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef7b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d7b6 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.959707:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.959721:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.959733:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664489.959743:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788664489.960191:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413ef7b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7b6 expref: 26 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.960211:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7b6 expref: 25 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.960220:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:2.0:1788664489.960222:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664489.960226:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c000, rc 0) 00000100:00100000:2.0:1788664489.960294:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+25:15633:x1875550119531520:12345-192.168.203.52@tcp:101:dd.0 Request processed in 747us (924us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788664489.960317:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:3.0:1788664489.965375:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664489.965432:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664489.965571:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119531776 00000100:00100000:1.0:1788664489.965581:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119531776 00000100:00100000:1.0:1788664489.965649:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:1.0:1788664489.965659:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+25:2392:x1875550119531776:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664489.965678:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664489.965701:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c000/0xcd11f61c1413ef82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7b6 expref: 25 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.965720:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664489.965725:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664489.965809:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+24:2392:x1875550119531776:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 151us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664489.965827:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:2.0:1788664489.967552:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119531648 00000100:00100000:2.0:1788664489.967564:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119531648 00000100:00100000:2.0:1788664489.967615:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:2.0:1788664489.967625:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+24:15633:x1875550119531648:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:2.0:1788664489.967649:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664489.967668:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413ef90 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d7bd expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.967703:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ef97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.967718:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ef97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.967729:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ef97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.968965:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413ef90 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7bd expref: 26 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.968991:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ef97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7bd expref: 25 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664489.969000:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:2.0:1788664489.969003:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788664489.969006:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c400, rc 0) 00000100:00100000:2.0:1788664489.969132:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+25:15633:x1875550119531648:12345-192.168.203.52@tcp:101:dd.0 Request processed in 1507us (3764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664489.969151:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:3.0:1788664489.994430:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664489.997024:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119532032 00000100:00100000:1.0:1788664489.997040:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119532032 00000100:00100000:1.0:1788664489.997133:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:1.0:1788664489.997145:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+25:15633:x1875550119532032:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:1.0:1788664489.997205:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664489.997247:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cdc00/0xcd11f61c1413ef35 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d79a expref: 25 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.997268:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664489.997274:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664489.997453:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ef9e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.997467:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ef9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.997477:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ef9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788664489.997518:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788664489.997539:0:17144:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005864af17 reply state 000000009347be8a transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ef9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.997550:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ef9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664489.997556:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664489.997559:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788664489.997561:0:17144:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788664489.997658:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+27:15633:x1875550119532032:12345-192.168.203.52@tcp:36:dd.0 Request processed in 516us (3238us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788664489.997666:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000020:00080000:1.0:1788664489.997676:0:17144:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788664490.147394:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664490.147490:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119532288 00000100:00100000:3.0:1788664490.147502:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119532288 00000100:00100000:3.0:1788664490.147566:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:3.0:1788664490.147577:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+27:15633:x1875550119532288:12345-192.168.203.52@tcp:35:dd.0 00000100:00100000:3.0:1788664490.147840:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+28:15633:x1875550119532288:12345-192.168.203.52@tcp:35:dd.0 Request processed in 264us (456us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1788664490.147848:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788664490.524921:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664490.525079:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119532416 00000100:00100000:1.0:1788664490.525092:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119532416 00000100:00100000:1.0:1788664490.525156:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:1.0:1788664490.525167:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+28:15647:x1875550119532416:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:1.0:1788664490.525192:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664490.525211:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413efa5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d7c4 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525312:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413efac lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525327:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413efac lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525348:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413efac lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525371:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de400/0xcd11f61c1413efb3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525380:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de400/0xcd11f61c1413efb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525387:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de400/0xcd11f61c1413efb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525498:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfe00/0xcd11f61c1413efba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525508:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfe00/0xcd11f61c1413efba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525526:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfe00/0xcd11f61c1413efba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664490.525575:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788664490.525580:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664490.525631:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfe00/0xcd11f61c1413efba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525645:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfe00/0xcd11f61c1413efba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525655:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413efac lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525662:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413efac lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525669:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413efac lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525675:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400031600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664490.525679:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413efac lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525687:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413efac lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525699:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c303884900) 00010000:00010000:1.0:1788664490.525703:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664490.525708:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413efac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525725:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031600/0xcd11f61c1413efac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525742:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de400/0xcd11f61c1413efb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525748:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de400/0xcd11f61c1413efb3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525755:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de400/0xcd11f61c1413efb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525759:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7de400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664490.525762:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de400/0xcd11f61c1413efb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525768:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de400/0xcd11f61c1413efb3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525841:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93c422270e00) 00010000:00010000:1.0:1788664490.525844:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664490.525847:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de400/0xcd11f61c1413efb3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.525853:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de400/0xcd11f61c1413efb3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.526202:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400031400/0xcd11f61c1413efa5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7c4 expref: 30 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.528103:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfe00/0xcd11f61c1413efba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7c4 expref: 29 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664490.528114:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664490.528117:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788664490.528120:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c42e7dfe00, rc 0) 00000100:00100000:1.0:1788664490.528204:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+29:15647:x1875550119532416:12345-192.168.203.52@tcp:101:stat.0 Request processed in 3039us (3292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664490.528220:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:1.0:1788664490.632576:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664490.632722:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119532672 00000100:00100000:2.0:1788664490.632734:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119532672 00000100:00100000:2.0:1788664490.632839:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:2.0:1788664490.632850:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+29:15653:x1875550119532672:12345-192.168.203.52@tcp:36:truncate.0 00010000:00010000:2.0:1788664490.632924:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664490.632950:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfe00/0xcd11f61c1413efba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7c4 expref: 29 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.632970:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:2.0:1788664490.632975:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664490.633140:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413efc1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.633155:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413efc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.633165:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413efc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664490.633205:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1788664490.633240:0:17144:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d47ad74b reply state 00000000031ca28a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413efc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.633252:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413efc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.633259:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:2.0:1788664490.633262:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788664490.633277:0:17144:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788664490.633405:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+31:15653:x1875550119532672:12345-192.168.203.52@tcp:36:truncate.0 Request processed in 557us (839us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788664490.633413:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000020:00080000:2.0:1788664490.633418:0:17144:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788664490.686330:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664490.884561:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664490.885254:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119532800 00000100:00100000:2.0:1788664490.885266:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119532800 00000100:00100000:2.0:1788664490.885357:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:2.0:1788664490.885369:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+31:15667:x1875550119532800:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:2.0:1788664490.885405:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664490.885432:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413efc8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d7cb expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.885512:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413efcf lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.885531:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413efcf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.885546:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413efcf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.885556:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413efd6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.885563:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413efd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.885569:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413efd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886212:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413efdd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886257:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413efdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886265:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413efdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664490.886322:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788664490.886328:0:18960:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788664490.886370:0:18960:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413efdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886384:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413efdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886404:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413efcf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886412:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413efcf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886420:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413efcf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886426:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ce00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664490.886432:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413efcf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886441:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413efcf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886456:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c303884900) 00010000:00010000:2.0:1788664490.886466:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664490.886473:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413efcf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886481:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413efcf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886500:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413efd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886506:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413efd6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886512:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413efd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886517:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0d000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664490.886520:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413efd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886526:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413efd6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886533:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93c422270e00) 00010000:00010000:2.0:1788664490.886536:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664490.886539:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413efd6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.886544:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413efd6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.887021:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413efc8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7cb expref: 33 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.887056:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413efdd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7cb expref: 32 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664490.887065:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:2.0:1788664490.887067:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664490.887070:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c800, rc 0) 00000100:00100000:2.0:1788664490.887239:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+32:15667:x1875550119532800:12345-192.168.203.52@tcp:101:stat.0 Request processed in 1872us (2692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664490.887251:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1788664491.056167:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664491.056278:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119533056 00000100:00100000:2.0:1788664491.056290:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119533056 00000100:00100000:2.0:1788664491.056389:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:2.0:1788664491.056410:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+32:15677:x1875550119533056:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788664491.056436:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664491.056470:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413efe4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d7d2 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664491.056596:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788664491.057926:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413efe4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7d2 expref: 34 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.057952:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6300) 00010000:00010000:2.0:1788664491.057956:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664491.057964:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413efe4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7d2 expref: 34 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.058007:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0da00, rc 0) 00000100:00100000:2.0:1788664491.058093:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+33:15677:x1875550119533056:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1685us (1937us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1788664491.058103:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00080000:0.0:1788664491.060523:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664491.072553:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140586112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664491.072659:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664491.073036:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140586112 00000100:00100000:0.0:1788664491.073102:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140586112 00000100:00100000:0.0:1788664491.073227:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788664491.073241:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140586112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788664491.073279:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788664491.073354:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875550140586112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664491.073362:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788664491.073417:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1875550140586112:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788664491.073509:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664491.075267:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664491.076886:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119533312 00000100:00100000:3.0:1788664491.076904:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119533312 00000100:00100000:3.0:1788664491.077063:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1788664491.077076:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c430648050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+33:15677:x1875550119533312:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788664491.077389:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c430648050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+34:15677:x1875550119533312:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 315us (2134us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788664491.077419:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000040:00080000:3.0:1788664491.134600:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788664491.206039:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664491.206310:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119533568 00000100:00100000:1.0:1788664491.206322:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119533568 00000100:00100000:1.0:1788664491.206411:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:1.0:1788664491.206423:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+34:15683:x1875550119533568:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788664491.206454:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664491.206496:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dec00/0xcd11f61c1413eff2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d7d9 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.206656:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.206675:0:17145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ef20 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d793 expref: 35 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.206684:0:17145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413efdd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7cb expref: 35 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.206712:0:17145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.206754:0:17145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413efdd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7cb expref: 35 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.206833:0:17145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413efdd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7cb expref: 35 pid: 18960 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664491.206849:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1875550140586240:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664491.206965:0:17145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ef20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d793 expref: 35 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.206975:0:17145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ef20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d793 expref: 35 pid: 17144 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664491.206984:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1875550140586368:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664491.207205:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4063830c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664491.210743:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1875550140586240:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664491.210763:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1875550140586368:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664491.210842:0:17145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664491.216298:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664491.216371:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664491.216875:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119533824 00000100:00100000:2.0:1788664491.216888:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119533824 00010000:00010000:2.0:1788664491.216944:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ef20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d793 expref: 36 pid: 17144 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664491.217253:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788664491.217270:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3038b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+36:2390:x1875550119533824:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664491.217309:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664491.217319:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ef20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d793 expref: 36 pid: 17144 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.217343:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ef20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d793 expref: 36 pid: 17144 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.217372:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c600/0xcd11f61c1413ef20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d793 expref: 36 pid: 17144 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.217392:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664491.217398:0:17128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.217409:0:17128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.217416:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664491.217490:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3038b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+35:2390:x1875550119533824:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 226us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664491.217498:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:2.0:1788664491.217671:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119533696 00000100:00100000:2.0:1788664491.217678:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119533696 00010000:00010000:2.0:1788664491.217698:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413efdd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7cb expref: 35 pid: 18960 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664491.217730:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1788664491.217738:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+35:2391:x1875550119533696:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664491.217747:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664491.217752:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413efdd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7cb expref: 35 pid: 18960 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.217762:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413efdd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7cb expref: 35 pid: 18960 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.217827:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413efdd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7cb expref: 35 pid: 18960 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.217853:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:2.0:1788664491.217857:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.217867:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.217876:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.217897:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664491.217921:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+34:2391:x1875550119533696:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 184us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664491.217928:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00010000:00010000:1.0:1788664491.218760:0:17145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.218796:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664491.218822:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1788664491.219287:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dec00/0xcd11f61c1413eff2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7d9 expref: 35 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.219325:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7d9 expref: 34 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.219345:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664491.219348:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788664491.219352:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c42e7df600, rc 0) 00000100:00100000:1.0:1788664491.219422:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+34:15683:x1875550119533568:12345-192.168.203.52@tcp:101:bash.0 Request processed in 13000us (13397us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1788664491.219432:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:3.0:1788664491.224264:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664491.224368:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119534080 00000100:00100000:2.0:1788664491.224380:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119534080 00000100:00100000:2.0:1788664491.224449:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:2.0:1788664491.224461:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+34:15683:x1875550119534080:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:2.0:1788664491.225271:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413f007 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.225297:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413f007 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.225312:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413f007 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664491.225378:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788664491.225402:0:17144:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ba70cae reply state 0000000018a0b6a0 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413f007 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.225436:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413f007 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.225445:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:2.0:1788664491.225448:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788664491.225452:0:17144:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788664491.226662:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+37:15683:x1875550119534080:12345-192.168.203.52@tcp:36:bash.0 Request processed in 1119us (1329us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788664491.226678:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000020:00080000:2.0:1788664491.226687:0:17144:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788664491.230247:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664491.230413:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119534208 00000100:00100000:2.0:1788664491.230425:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119534208 00000100:00100000:2.0:1788664491.230548:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:2.0:1788664491.230561:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+37:15683:x1875550119534208:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788664491.230603:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664491.230630:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413f00e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d7e0 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.230707:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413f00e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7e0 expref: 38 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.230725:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413f00e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7e0 expref: 38 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.230747:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:2.0:1788664491.230751:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788664491.230755:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0da00, rc 0) 00000100:00100000:2.0:1788664491.230885:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+38:15683:x1875550119534208:12345-192.168.203.52@tcp:101:bash.0 Request processed in 327us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664491.230900:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:3.0:1788664491.235905:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664491.236151:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119534336 00000100:00100000:1.0:1788664491.236164:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119534336 00000100:00100000:1.0:1788664491.236239:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:1.0:1788664491.236260:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+38:15683:x1875550119534336:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788664491.236288:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664491.236317:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dec00/0xcd11f61c1413f015 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d7e7 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.236443:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f01c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.236460:0:17143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7d9 expref: 39 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.236470:0:17143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f01c lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.236512:0:17143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7d9 expref: 39 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.236546:0:17143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7d9 expref: 39 pid: 17145 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664491.236561:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1875550140586496:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788664491.236917:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c406383180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664491.240686:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664491.240791:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119534464 00000100:00100000:3.0:1788664491.240804:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119534464 00010000:00010000:3.0:1788664491.240855:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7d9 expref: 40 pid: 17145 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664491.240909:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788664491.240920:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+40:2390:x1875550119534464:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664491.240939:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664491.240947:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7d9 expref: 40 pid: 17145 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664491.240963:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7d9 expref: 40 pid: 17145 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664491.240992:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:3.0:1788664491.240999:0:17128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f01c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664491.241010:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f01c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664491.241041:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f01c lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664491.241066:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664491.241135:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+40:2390:x1875550119534464:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 216us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664491.241143:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00010000:00010000:1.0:1788664491.242794:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413eff9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7d9 expref: 39 pid: 17145 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664491.242827:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1875550140586496:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788664491.242853:0:17143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f01c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.242866:0:17143:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f01c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.242872:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f01c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664491.243016:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788664491.243023:0:17143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664491.243050:0:17143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f01c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.243095:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dec00/0xcd11f61c1413f015 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7e7 expref: 39 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.243112:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f01c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7e7 expref: 38 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.243143:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664491.243146:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788664491.243150:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c42e7de800, rc 0) 00000100:00100000:1.0:1788664491.243490:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+38:15683:x1875550119534336:12345-192.168.203.52@tcp:101:bash.0 Request processed in 7239us (7604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664491.243501:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:0.0:1788664491.247595:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664491.248033:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119534720 00000100:00100000:1.0:1788664491.248045:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119534720 00000100:00100000:1.0:1788664491.248165:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1788664491.248179:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+38:15683:x1875550119534720:12345-192.168.203.52@tcp:103:bash.0 00010000:00010000:1.0:1788664491.248199:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788664491.248232:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413f00e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7e0 expref: 38 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.248260:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f01c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7e7 expref: 37 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.248284:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664491.248292:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664491.248372:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+36:15683:x1875550119534720:12345-192.168.203.52@tcp:103:bash.0 Request processed in 196us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664491.248381:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:0.0:1788664491.251091:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664491.251189:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119534848 00000100:00100000:1.0:1788664491.251200:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119534848 00000100:00100000:1.0:1788664491.251373:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:1.0:1788664491.251394:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+36:15683:x1875550119534848:12345-192.168.203.52@tcp:58:bash.0 00010000:00010000:1.0:1788664491.251543:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dea00/0xcd11f61c1413f023 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.251564:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dea00/0xcd11f61c1413f023 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664491.251578:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dea00/0xcd11f61c1413f023 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788664491.261414:0:17145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664491.268692:0:17145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788664491.268903:0:17145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788664491.269014:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+36:15683:x1875550119534848:12345-192.168.203.52@tcp:58:bash.0 Request processed in 17625us (17929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664491.271527:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:0.0:1788664491.275822:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664491.275985:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119534976 00000100:00100000:2.0:1788664491.275997:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119534976 00000100:00100000:2.0:1788664491.276068:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:2.0:1788664491.276079:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c42266ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+36:15683:x1875550119534976:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788664491.276100:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664491.276121:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413f02a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d7ee expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.276383:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dea00/0xcd11f61c1413f023 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.276457:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413f02a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7ee expref: 37 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.276478:0:17144:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dea00/0xcd11f61c1413f023 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.276493:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413f02a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7ee expref: 37 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.276507:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:2.0:1788664491.276510:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788664491.276514:0:17144:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413f02a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7ee expref: 37 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664491.276521:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0d000, rc 0) 00000100:00100000:2.0:1788664491.276605:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c42266ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+37:15683:x1875550119534976:12345-192.168.203.52@tcp:101:bash.0 Request processed in 527us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664491.276613:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:0.0:1788664491.582316:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c30480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140586624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788664491.582411:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664491.582607:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140586880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788664491.582656:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664491.582705:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140587392:0@lo:400:kworker.0 00000100:00100000:3.0:1788664491.582714:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140587136:0@lo:400:kworker.0 00000100:00100000:2.0:1788664491.582746:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664491.582803:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140587904:0@lo:400:kworker.0 00000100:00100000:3.0:1788664491.582816:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664491.582840:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664491.582866:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140587648:0@lo:400:kworker.0 00000100:00100000:0.0:1788664491.582898:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140586752:0@lo:400:kworker.0 00000100:00100000:1.0:1788664491.583000:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140586624 00000100:00100000:1.0:1788664491.583008:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140586624 00000100:00100000:1.0:1788664491.583047:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140586880 00000100:00100000:1.0:1788664491.583049:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140586880 00000100:00100000:1.0:1788664491.583065:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788664491.583073:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140586624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788664491.583108:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788664491.588097:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664491.588119:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140588288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788664491.588247:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664491.588318:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140588160:0@lo:400:kworker.0 00000100:00100000:3.0:1788664491.588391:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664491.588426:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788664491.588435:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140587008:0@lo:400:kworker.0 00000100:00100000:3.0:1788664491.588463:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664491.588476:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140587520:0@lo:400:kworker.0 00000100:00100000:3.0:1788664491.588501:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664491.588523:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140588032:0@lo:400:kworker.0 00000100:00100000:3.0:1788664491.588547:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664491.588595:0:19534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140587136 00000100:00100000:3.0:1788664491.588604:0:19534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140587136 00000100:00100000:3.0:1788664491.588667:0:19534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140587520 00000100:00100000:3.0:1788664491.588817:0:19534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140587520 00000100:00100000:3.0:1788664491.588847:0:19534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788664491.588857:0:19534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140587136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664491.588947:0:19534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140587136:12345-0@lo:400:kworker.0 Request processed in 91us (6133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664491.588956:0:19534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788664491.588976:0:19534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788664491.588983:0:19534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140587520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664491.589115:0:19534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140587520:12345-0@lo:400:kworker.0 Request processed in 132us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664491.589123:0:19534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788664491.589285:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140587520:0@lo:400:kworker.0 00000100:00100000:3.0:1788664491.589298:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140587136:0@lo:400:kworker.0 00000100:00080000:3.0:1788664491.589323:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788664491.589341:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664491.590476:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664491.591578:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140587392 00000100:00100000:2.0:1788664491.591590:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140587392 00000100:00100000:2.0:1788664491.591637:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140587904 00000100:00100000:2.0:1788664491.591640:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140587904 00000100:00080000:2.0:1788664491.591817:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664491.591838:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140587648 00000100:00100000:2.0:1788664491.592036:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140587648 00000100:00100000:2.0:1788664491.592056:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140588160 00000100:00100000:2.0:1788664491.592059:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140588160 00000100:00080000:2.0:1788664491.592075:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788664491.592087:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140588032 00000100:00100000:2.0:1788664491.592090:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140588032 00000100:00080000:2.0:1788664491.592102:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664491.592117:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788664491.592127:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140587392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664491.592281:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875550140587392:12345-0@lo:400:kworker.0 Request processed in 156us (9535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664491.592300:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788664491.593806:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875550140587392:0@lo:400:kworker.0 00000100:00100000:2.0:1788664491.593918:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788664491.593932:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140587904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664491.593998:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875550140587904:12345-0@lo:400:kworker.0 Request processed in 72us (11161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664491.594006:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1788664491.594042:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039d6d80 x1875550140587904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664491.594055:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1875550140587904:0@lo:400:kworker.0 00000100:00100000:2.0:1788664491.594074:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788664491.594081:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140587648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664491.594400:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788664491.594409:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140588160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664491.594455:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875550140588160:12345-0@lo:400:kworker.0 Request processed in 48us (6064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664491.594461:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788664491.594476:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788664491.594484:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140588032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664491.594522:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875550140588032:12345-0@lo:400:kworker.0 Request processed in 40us (5974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664491.594528:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788664491.594633:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140588544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664491.594684:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664491.594738:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875550140586624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 11664us (12326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664491.594747:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788664491.594762:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140587008 00000100:00100000:1.0:1788664491.594782:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140587008 00000100:00100000:1.0:1788664491.594807:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788664491.594814:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1875550140586880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788664491.594841:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788664491.594874:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1875550140586880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (12220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664491.594879:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788664491.594891:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788664491.594896:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140587008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664491.594922:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140587008:12345-0@lo:400:kworker.0 Request processed in 27us (6458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664491.594928:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788664491.594964:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140588288 00000100:00100000:1.0:1788664491.594968:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140588288 00000100:00100000:1.0:1788664491.594984:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140588544 00000100:00100000:1.0:1788664491.594987:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140588544 00000100:00100000:1.0:1788664491.595009:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788664491.595015:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140588288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788664491.595038:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788664491.595068:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140588288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (4595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664491.595074:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788664491.595085:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788664491.595091:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140588544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664491.595111:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788664491.595156:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875550140588544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664491.595161:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788664491.595192:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1875550140588544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664491.595228:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3036f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140588416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664491.595254:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664491.595280:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140588288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788664491.595293:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140586880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788664491.595313:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140588416 00000100:00100000:1.0:1788664491.595317:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140588416 00000100:00100000:1.0:1788664491.595348:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788664491.595354:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140588416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664491.595364:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788664491.595395:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875550140588416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664491.595401:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788664491.595426:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3036f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1875550140588416:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788664491.595449:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788664491.595494:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140587008:0@lo:400:kworker.0 00000100:00100000:1.0:1788664491.595506:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1875550140588032:0@lo:400:kworker.0 00010000:00080000:1.0:1788664491.595518:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93c3039d5c00 x1875550140588160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664491.595527:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1875550140588160:0@lo:400:kworker.0 00000100:00100000:1.0:1788664491.595542:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c30480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1875550140586624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788664491.597393:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875550140587648:12345-0@lo:400:kworker.0 Request processed in 3304us (9144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664491.597406:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788664491.597462:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875550140587648:0@lo:400:kworker.0 00000100:00100000:0.0:1788664491.603865:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664491.603942:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140587264:0@lo:400:kworker.0 00000100:00100000:0.0:1788664491.603990:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664491.604021:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140587776:0@lo:400:kworker.0 00000100:00100000:0.0:1788664491.604050:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664491.604082:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140587776 00000100:00100000:0.0:1788664491.604092:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140587776 00000100:00100000:1.0:1788664491.604219:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140586752 00000100:00100000:1.0:1788664491.604223:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140586752 00000100:00100000:1.0:1788664491.604263:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788664491.604272:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c43536d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:3638:x1875550140586752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664491.604325:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c43536d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd+24:3638:x1875550140586752:12345-0@lo:400:kworker.0 Request processed in 54us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664491.604343:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788664491.604417:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b799a9c-462a-4acf-8dbe-41fb3ef57cfd:3638:1875550140586752:0@lo:400:kworker.0 00000100:00080000:1.0:1788664491.604448:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664491.605237:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788664491.605247:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140587776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664491.605297:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875550140587776:12345-0@lo:400:kworker.0 Request processed in 53us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664491.605304:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788664491.605348:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1875550140587776:0@lo:400:kworker.0 00000100:00100000:2.0:1788664491.605430:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140587264 00000100:00100000:2.0:1788664491.605435:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140587264 00000100:00100000:2.0:1788664491.605469:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788664491.605477:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140587264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664491.605516:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875550140587264:12345-0@lo:400:kworker.0 Request processed in 40us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664491.605521:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788664491.605823:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1875550140587264:0@lo:400:kworker.0 00010000:00010000:0.0:1788664491.713191:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788664492.157974:0:17178:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788664492.157983:0:17178:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788664492.158039:0:17178:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788664492.158050:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788664492.158190:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17178:1875550140588672:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788664492.158299:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4063d3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664492.163634:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17178:1875550140588672:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788664492.182532:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664492.183095:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119535104 00000100:00100000:1.0:1788664492.183107:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119535104 00000100:00100000:1.0:1788664492.183172:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:1.0:1788664492.183183:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+37:15684:x1875550119535104:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788664492.183218:0:18960:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788664492.183357:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+37:15684:x1875550119535104:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 174us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664492.183382:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:0.0:1788664492.197559:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664492.197756:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119535232 00000100:00100000:1.0:1788664492.197802:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119535232 00000100:00100000:1.0:1788664492.197872:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:1.0:1788664492.197883:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+37:15684:x1875550119535232:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788664492.197958:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f031 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.197976:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f031 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.197990:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f031 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198034:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dec00/0xcd11f61c1413f038 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198043:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dec00/0xcd11f61c1413f038 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198050:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dec00/0xcd11f61c1413f038 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198070:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f03f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198079:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f03f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198086:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f03f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664492.198143:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788664492.198147:0:17143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664492.198160:0:17143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f03f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198171:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f031 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198178:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f031 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198186:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f031 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198192:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7de800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.198197:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f031 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198205:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f031 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198217:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c3027e6c00) 00010000:00010000:1.0:1788664492.198220:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664492.198225:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f031 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198231:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de800/0xcd11f61c1413f031 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198243:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dec00/0xcd11f61c1413f038 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198259:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dec00/0xcd11f61c1413f038 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198265:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dec00/0xcd11f61c1413f038 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198271:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7dec00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.198274:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dec00/0xcd11f61c1413f038 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198281:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dec00/0xcd11f61c1413f038 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198288:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff93c3027e6800) 00010000:00010000:1.0:1788664492.198291:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664492.198294:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dec00/0xcd11f61c1413f038 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198300:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dec00/0xcd11f61c1413f038 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198315:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f03f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198320:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f03f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198336:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f03f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198341:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7df600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.198361:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f03f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198368:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f03f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198377:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664492.198380:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664492.198382:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f03f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.198388:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f03f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664492.198467:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+37:15684:x1875550119535232:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 586us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664492.198475:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:0.0:1788664492.202550:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664492.202619:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119535488 00000100:00100000:1.0:1788664492.202629:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119535488 00000100:00100000:1.0:1788664492.202683:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1788664492.202692:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+37:15684:x1875550119535488:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664492.202712:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664492.202729:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f046 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d7f5 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.202837:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f04d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.202852:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f04d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.202878:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f04d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664492.202890:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788664492.202962:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f04d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.202970:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f04d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.202977:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f04d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.202982:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7de600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.202986:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f04d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.202993:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f04d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.203004:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664492.203007:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788664492.203011:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f04d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.203018:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f04d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.203052:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f046 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7f5 expref: 39 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.203072:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c3027e6c00) 00010000:00010000:1.0:1788664492.203074:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788664492.203078:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f046 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7f5 expref: 39 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.203087:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c42e7dfc00, rc 0) 00000100:00100000:1.0:1788664492.203141:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+38:15684:x1875550119535488:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 450us (599us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1788664492.203149:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:0.0:1788664492.211277:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664492.211385:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119535616 00000100:00100000:1.0:1788664492.211396:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119535616 00000100:00100000:1.0:1788664492.211459:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:1.0:1788664492.211470:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+38:15684:x1875550119535616:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788664492.211507:0:17143:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788664492.211620:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+38:15684:x1875550119535616:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 152us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664492.211629:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1788664492.216750:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664492.216858:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119535872 00000100:00100000:1.0:1788664492.216870:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119535872 00000100:00100000:1.0:1788664492.216931:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:1.0:1788664492.216941:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+38:15684:x1875550119535872:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664492.216964:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664492.216983:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f05b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d7fc expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788664492.217518:0:18960:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:1.0:1788664492.217526:0:18960:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:1.0:1788664492.217545:0:18960:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:1.0:1788664492.217891:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f062 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.217907:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f062 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.217919:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f062 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.218875:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f05b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7fc expref: 41 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.218899:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f062 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7fc expref: 40 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.218908:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c3027e6800) 00010000:00010000:1.0:1788664492.218911:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788664492.218914:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c42e7de600, rc 0) 00000100:00100000:1.0:1788664492.219041:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+40:15684:x1875550119535872:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 2099us (2299us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788664492.219051:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:0.0:1788664492.244309:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664492.244503:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119536128 00000100:00100000:1.0:1788664492.244515:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119536128 00000100:00100000:1.0:1788664492.244577:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:1.0:1788664492.244598:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+40:15684:x1875550119536128:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788664492.244688:0:17143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664492.244713:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f062 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7fc expref: 40 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.244732:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c3027e6800) 00010000:00010000:1.0:1788664492.244743:0:17143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664492.244766:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f070 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.244835:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f070 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.244846:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f070 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.244862:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f077 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe1252393 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.244869:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f077 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1252393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.244876:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f077 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1252393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.244932:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f070 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.244939:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f070 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.244946:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f070 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.244958:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7dfc00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.244963:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f070 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.244971:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f070 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.244980:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c303884900) 00010000:00010000:1.0:1788664492.244982:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664492.244986:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f070 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.244992:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f070 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.245000:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f077 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1252393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.245005:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f077 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1252393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.245010:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f077 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1252393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.245015:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7df600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.245018:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f077 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1252393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.245024:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f077 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1252393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.245043:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xe1252393 (ffff93c3027e6200) 00010000:00010000:1.0:1788664492.245046:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664492.245049:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f077 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe1252393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.245055:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f077 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe1252393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664492.245138:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+39:15684:x1875550119536128:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 539us (837us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788664492.245146:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:0.0:1788664492.255555:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664492.255693:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119536256 00000100:00100000:2.0:1788664492.255704:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119536256 00000100:00100000:2.0:1788664492.255765:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:2.0:1788664492.255802:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+39:15684:x1875550119536256:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664492.255823:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664492.255843:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413f07e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d803 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.255877:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413f085 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.255903:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413f085 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.255916:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413f085 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.256032:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413f07e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d803 expref: 41 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.256049:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0da00/0xcd11f61c1413f085 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d803 expref: 40 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.256057:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c422270600) 00010000:00010000:2.0:1788664492.256060:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788664492.256063:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0da00, rc 0) 00000100:00100000:2.0:1788664492.256129:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+40:15684:x1875550119536256:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 330us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664492.256137:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:0.0:1788664492.261998:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664492.262078:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119536512 00000100:00100000:1.0:1788664492.262089:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119536512 00000100:00100000:1.0:1788664492.262145:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:1.0:1788664492.262156:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+40:15684:x1875550119536512:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788664492.262254:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f08c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.262272:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f08c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.262285:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f08c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788664492.262465:0:17143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1788664492.262477:0:17143:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 587399704956ns, next at 588399701256ns, rc = 0 00000004:00010000:1.0:1788664492.262526:0:17143:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049c4eda3 reply state 00000000a3dbae43 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f08c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.262558:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f08c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.262566:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c422270600) 00010000:00010000:1.0:1788664492.262569:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788664492.262573:0:17143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788664492.262667:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+42:15684:x1875550119536512:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 512us (678us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1788664492.262674:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:0.0:1788664492.270198:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664492.270294:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119536640 00000100:00100000:2.0:1788664492.270305:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119536640 00000100:00100000:2.0:1788664492.270384:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:2.0:1788664492.270395:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+42:15684:x1875550119536640:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664492.270425:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664492.270445:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413f093 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d80a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.270507:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413f093 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d80a expref: 43 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.270522:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413f093 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d80a expref: 43 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.270540:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c422270600) 00010000:00010000:2.0:1788664492.270543:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788664492.270547:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0ce00, rc 0) 00000100:00100000:2.0:1788664492.270613:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+43:15684:x1875550119536640:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 220us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664492.270621:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:0.0:1788664492.282523:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664492.282608:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119536768 00000100:00100000:3.0:1788664492.282620:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119536768 00000100:00100000:3.0:1788664492.282690:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788664492.282701:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2390:x1875550119536768:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788664492.282980:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:2390:x1875550119536768:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 280us (466us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788664492.283004:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00080000:1.0:1788664492.284040:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664492.297346:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664492.297747:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119537024 00000100:00100000:2.0:1788664492.297758:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119537024 00000100:00100000:2.0:1788664492.297833:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788664492.297842:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+43:15684:x1875550119537024:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788664492.298056:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+44:15684:x1875550119537024:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 214us (729us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788664492.298064:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788664492.302997:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664492.306998:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119537280 00000100:00100000:1.0:1788664492.307016:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119537280 00000100:00100000:2.0:1788664492.311487:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:2.0:1788664492.311504:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+44:15684:x1875550119537280:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788664492.311687:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+44:15684:x1875550119537280:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 187us (8698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664492.311696:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:0.0:1788664492.318067:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664492.318152:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119537408 00000100:00100000:1.0:1788664492.318163:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119537408 00000100:00100000:1.0:1788664492.318218:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:1.0:1788664492.318228:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+44:15684:x1875550119537408:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664492.318249:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664492.318267:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f09a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d811 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.318339:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f0a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.318354:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.318366:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664492.318419:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788664492.318438:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.318461:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfc00/0xcd11f61c1413f09a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d811 expref: 46 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.318477:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f0a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d811 expref: 45 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.318486:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c422270600) 00010000:00010000:1.0:1788664492.318489:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788664492.318493:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c42e7de600, rc 0) 00000100:00100000:1.0:1788664492.318651:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+45:15684:x1875550119537408:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 423us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664492.318659:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:0.0:1788664492.332125:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664492.332243:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119537536 00000100:00100000:3.0:1788664492.332256:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119537536 00000100:00100000:3.0:1788664492.332317:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788664492.332337:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:2391:x1875550119537536:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664492.332357:0:19229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664492.332386:0:19229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aafe2311/0xcd11f61c1413f0a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d818 expref: -99 pid: 19229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788664492.332411:0:19229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cdaac, blocks: 0x0 00010000:00010000:3.0:1788664492.332432:0:19229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1788664492.332437:0:19229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664492.332446:0:19229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aafe2311/0xcd11f61c1413f0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d818 expref: 7 pid: 19229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.332466:0:19229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aafe2311/0xcd11f61c1413f0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d818 expref: 7 pid: 19229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.332479:0:19229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c303b84c00, rc 0) 00000100:00100000:3.0:1788664492.332541:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+7:2391:x1875550119537536:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 215us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664492.332548:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788664492.342895:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664492.343057:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119537792 00000100:00100000:1.0:1788664492.343069:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119537792 00000100:00100000:1.0:1788664492.343134:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:1.0:1788664492.343145:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+45:15684:x1875550119537792:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788664492.343270:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+45:15684:x1875550119537792:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 126us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664492.343286:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:0.0:1788664492.349705:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664492.349976:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119537920 00000100:00100000:1.0:1788664492.349987:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119537920 00000100:00100000:1.0:1788664492.350060:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:1.0:1788664492.350089:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+45:15684:x1875550119537920:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788664492.352400:0:17123:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1788664492.352415:0:17123:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788664492.352492:0:17123:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1788664492.352596:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413eebe lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.352609:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413eebe lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.352617:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413eebe lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.352623:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7cd000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:2.0:1788664492.352628:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413eebe lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.352635:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413eebe lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.352651:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c303884900) 00010000:00010000:2.0:1788664492.352653:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788664492.352657:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413eebe lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.352663:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413eebe lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352800:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cce00/0xcd11f61c1413ee6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352808:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cce00/0xcd11f61c1413ee6a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352814:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cce00/0xcd11f61c1413ee6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352819:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7cce00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.352822:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cce00/0xcd11f61c1413ee6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352828:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cce00/0xcd11f61c1413ee6a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352837:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c303884800) 00010000:00010000:1.0:1788664492.352839:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664492.352843:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cce00/0xcd11f61c1413ee6a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352848:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cce00/0xcd11f61c1413ee6a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352871:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd200/0xcd11f61c1413ee71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352881:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd200/0xcd11f61c1413ee71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352897:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd200/0xcd11f61c1413ee71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352907:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7cd200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.352911:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd200/0xcd11f61c1413ee71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352917:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd200/0xcd11f61c1413ee71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352925:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c303884900) 00010000:00010000:1.0:1788664492.352928:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664492.352930:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd200/0xcd11f61c1413ee71 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352936:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd200/0xcd11f61c1413ee71 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352948:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413ef19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352954:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413ef19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352960:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413ef19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352965:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ca00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.352968:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413ef19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352986:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413ef19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.352994:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93c422270e00) 00010000:00010000:1.0:1788664492.352997:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664492.353000:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413ef19 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353005:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413ef19 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353020:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ef9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353026:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ef9e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353031:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ef9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353036:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c400030a00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.353039:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ef9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353045:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ef9e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353052:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664492.353054:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664492.353057:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ef9e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353068:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c400030a00/0xcd11f61c1413ef9e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353081:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413efc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353088:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413efc1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353093:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413efc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353097:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.353100:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413efc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353105:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413efc1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353112:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664492.353114:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664492.353116:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413efc1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353121:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413efc1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353131:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413f007 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353137:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413f007 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353148:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413f007 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353153:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.353156:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413f007 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353162:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413f007 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353171:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664492.353173:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664492.353176:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413f007 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353250:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c800/0xcd11f61c1413f007 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353265:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f08c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353270:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f08c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353276:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f08c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353281:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7df600 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.353284:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f08c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353301:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f08c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353310:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c422270600) 00010000:00010000:1.0:1788664492.353313:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788664492.353316:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f08c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.353321:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df600/0xcd11f61c1413f08c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664492.353476:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+14:15684:x1875550119537920:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 3384us (3776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664492.353486:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:2.0:1788664492.353823:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140588800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788664492.353906:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664492.354651:0:19534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140588800 00000100:00100000:0.0:1788664492.354662:0:19534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140588800 00000100:00100000:0.0:1788664492.354726:0:19534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788664492.354736:0:19534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4072a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1875550140588800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788664492.354941:0:19534:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788664492.354945:0:19534:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788664492.354947:0:19534:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788664492.354948:0:19534:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788664492 -> 1788664492 00002000:00010000:0.0:1788664492.354951:0:19534:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788664492.355006:0:19534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4072a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3637:x1875550140588800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 271us (1100us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788664492.355012:0:19534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:2.0:1788664492.355431:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c301eaaa00/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788664492.355438:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1875550140588800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788664492.356385:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664492.356468:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119538048 00000100:00100000:3.0:1788664492.356475:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119538048 00000100:00100000:3.0:1788664492.356522:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:3.0:1788664492.356531:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+7:2390:x1875550119538048:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788664492.356614:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+7:2390:x1875550119538048:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 84us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664492.356621:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:3.0:1788664492.358940:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664492.359099:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119538304 00000100:00100000:0.0:1788664492.359115:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119538304 00000100:00100000:0.0:1788664492.359170:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:0.0:1788664492.359184:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+14:15684:x1875550119538304:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788664492.359252:0:18960:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664492.359282:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7de600/0xcd11f61c1413f0a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d811 expref: 14 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.359298:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c422270600) 00010000:00010000:0.0:1788664492.359308:0:18960:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664492.359346:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cc600/0xcd11f61c1413f0af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.359374:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cc600/0xcd11f61c1413f0af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.359384:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cc600/0xcd11f61c1413f0af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664492.359501:0:18960:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000955aa7b7 reply state 0000000071add587 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cc600/0xcd11f61c1413f0af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.359518:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cc600/0xcd11f61c1413f0af lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.359525:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c422270600) 00010000:00010000:0.0:1788664492.359528:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788664492.359530:0:18960:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788664492.359633:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+15:15684:x1875550119538304:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 449us (701us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788664492.359640:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:1.0:1788664492.363003:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664492.363096:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119538432 00000100:00100000:2.0:1788664492.363108:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119538432 00000100:00100000:2.0:1788664492.363161:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1788664492.363190:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+7:15684:x1875550119538432:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664492.363215:0:18649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664492.363237:0:18649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1f02/0xcd11f61c1413f0b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d81f expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.363276:0:18649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aafe2311/0xcd11f61c1413f0a8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d818 expref: 8 pid: 19229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.363286:0:18649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664492.363290:0:18649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664492.363303:0:18649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1f02/0xcd11f61c1413f0b6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d81f expref: 8 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.363352:0:18649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aafe2311/0xcd11f61c1413f0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d818 expref: 8 pid: 19229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.363366:0:18649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aafe2311/0xcd11f61c1413f0a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d818 expref: 8 pid: 19229 timeout: 687 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664492.363381:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18649:1875550140588928:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664492.363502:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c404735a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664492.370288:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18649:1875550140588928:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788664492.370343:0:18649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1f02/0xcd11f61c1413f0b6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d81f expref: 8 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.370364:0:18649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c000, rc 0) 00000100:00100000:2.0:1788664492.370429:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+8:15684:x1875550119538432:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 7258us (7435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664492.370440:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:3.0:1788664492.371865:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664492.371957:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119538560 00000100:00100000:2.0:1788664492.371967:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119538560 00010000:00010000:2.0:1788664492.372005:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aafe2311/0xcd11f61c1413f0a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d818 expref: 8 pid: 19229 timeout: 687 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664492.372045:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1788664492.372055:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+8:2391:x1875550119538560:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664492.372071:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664492.372092:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aafe2311/0xcd11f61c1413f0a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d818 expref: 8 pid: 19229 timeout: 687 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.372105:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aafe2311/0xcd11f61c1413f0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d818 expref: 8 pid: 19229 timeout: 687 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.372127:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aafe2311/0xcd11f61c1413f0a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d818 expref: 8 pid: 19229 timeout: 687 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.372162:0:17129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664492.372166:0:17129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664492.372173:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1f02/0xcd11f61c1413f0b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d81f expref: 7 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.372299:0:17129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1f02/0xcd11f61c1413f0b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d81f expref: 7 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.372347:0:17129:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1f02/0xcd11f61c1413f0b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d81f expref: 7 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664492.372362:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17129:1875550140589056:192.168.203.52@tcp:105: 00000100:00100000:2.0:1788664492.372475:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c404735a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664492.379481:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664492.379608:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17129:1875550140589056:192.168.203.52@tcp:105: 00010000:00010000:2.0:1788664492.379633:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664492.379702:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+7:2391:x1875550119538560:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 7648us (7845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664492.379712:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788664492.380166:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119538688 00000100:00100000:3.0:1788664492.380175:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119538688 00000100:00100000:3.0:1788664492.380276:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1788664492.380286:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+7:2390:x1875550119538688:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788664492.380436:0:18651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788664492.380441:0:18651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788664491 00002000:00010000:3.0:1788664492.380443:0:18651:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788664489 00002000:00010000:3.0:1788664492.380445:0:18651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788664492 -> 1788664491 00002000:00010000:3.0:1788664492.380448:0:18651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788664492.380496:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+8:2390:x1875550119538688:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 211us (1024us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788664492.380504:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1788664492.385881:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664492.385967:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119538816 00000100:00100000:0.0:1788664492.385979:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119538816 00000100:00100000:0.0:1788664492.386046:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:0.0:1788664492.386057:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+8:2393:x1875550119538816:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788664492.386105:0:19229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000accfc36e/0xcd11f61c1413f0bd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.386125:0:19229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1f02/0xcd11f61c1413f0b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d81f expref: 8 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.386152:0:19229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664492.386156:0:19229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664492.386161:0:19229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000accfc36e/0xcd11f61c1413f0bd lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.386214:0:19229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1f02/0xcd11f61c1413f0b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d81f expref: 8 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.386230:0:19229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1f02/0xcd11f61c1413f0b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d81f expref: 8 pid: 18649 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664492.386245:0:19229:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c301eaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19229:1875550140589184:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788664492.386344:0:19229:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42248dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664492.390356:0:19229:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c301eaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19229:1875550140589184:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788664492.390389:0:19229:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000accfc36e/0xcd11f61c1413f0bd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664492.395172:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664492.395339:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119538944 00000100:00100000:0.0:1788664492.395351:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119538944 00010000:00010000:0.0:1788664492.395396:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1f02/0xcd11f61c1413f0b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d81f expref: 9 pid: 18649 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664492.395439:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:0.0:1788664492.395451:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+9:2391:x1875550119538944:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664492.395483:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664492.395506:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1f02/0xcd11f61c1413f0b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d81f expref: 9 pid: 18649 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.395520:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1f02/0xcd11f61c1413f0b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d81f expref: 9 pid: 18649 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.395543:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1f02/0xcd11f61c1413f0b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d81f expref: 9 pid: 18649 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.395563:0:17130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664492.395567:0:17130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664492.395572:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000accfc36e/0xcd11f61c1413f0bd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.395587:0:17130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000accfc36e/0xcd11f61c1413f0bd lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.395621:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664492.395691:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+8:2391:x1875550119538944:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 242us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664492.395699:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00010000:00010000:1.0:1788664492.396611:0:19229:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000accfc36e/0xcd11f61c1413f0bd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.396625:0:19229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000accfc36e/0xcd11f61c1413f0bd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.396651:0:19229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000accfc36e/0xcd11f61c1413f0bd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.396659:0:19229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000accfc36e/0xcd11f61c1413f0bd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.396678:0:19229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000accfc36e/0xcd11f61c1413f0bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.396686:0:19229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7cc200 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:1.0:1788664492.396690:0:19229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000accfc36e/0xcd11f61c1413f0bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.396699:0:19229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000accfc36e/0xcd11f61c1413f0bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.396712:0:19229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000accfc36e/0xcd11f61c1413f0bd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.396720:0:19229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000accfc36e/0xcd11f61c1413f0bd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664492.396817:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+7:2393:x1875550119538816:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 10761us (10944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664492.396825:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:1.0:1788664492.407172:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664492.407339:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119539200 00000100:00100000:2.0:1788664492.407351:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119539200 00000100:00100000:2.0:1788664492.407412:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:2.0:1788664492.407423:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+15:15684:x1875550119539200:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788664492.407500:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413f0c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.407529:0:17143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ef97 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7bd expref: 15 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.407540:0:17143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413f0c4 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.407574:0:17143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ef97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7bd expref: 15 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.407587:0:17143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ef97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7bd expref: 15 pid: 18960 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664492.407602:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1875550140589312:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788664492.407684:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c404735480 going to sleep for 11 seconds 00000100:00100000:2.0:1788664492.412339:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1875550140589312:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788664492.412373:0:17143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413f0c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664492.418448:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664492.418562:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119539328 00000100:00100000:0.0:1788664492.418575:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119539328 00010000:00010000:0.0:1788664492.418620:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ef97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7bd expref: 16 pid: 18960 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664492.418686:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1788664492.418698:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+16:2390:x1875550119539328:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664492.418717:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664492.418725:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ef97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7bd expref: 16 pid: 18960 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.418739:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ef97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7bd expref: 16 pid: 18960 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.418759:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c400/0xcd11f61c1413ef97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7bd expref: 16 pid: 18960 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.418792:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:0.0:1788664492.418799:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413f02a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7ee expref: 15 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.418809:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413f0c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.418817:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413f0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.418824:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413f0c4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.418854:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664492.418883:0:17143:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413f0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.418900:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413f0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664492.419063:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+16:2390:x1875550119539328:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 366us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664492.419076:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00010000:00010000:3.0:1788664492.419106:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413f0cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.419118:0:17143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413f093 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d80a expref: 15 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.419126:0:17143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413f0cb lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.419157:0:17143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413f093 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d80a expref: 15 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.419170:0:17143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413f093 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d80a expref: 15 pid: 17144 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664492.419184:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1875550140589440:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788664492.419239:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c4063d3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664492.427285:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1875550140589440:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788664492.427330:0:17143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413f0cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664492.430138:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664492.430748:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119539456 00000100:00100000:3.0:1788664492.430761:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119539456 00010000:00010000:3.0:1788664492.430873:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413f093 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d80a expref: 16 pid: 17144 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664492.431059:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:3.0:1788664492.431071:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3038b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+16:2391:x1875550119539456:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664492.431089:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664492.431096:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413f093 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d80a expref: 16 pid: 17144 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.431127:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413f093 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d80a expref: 16 pid: 17144 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.431147:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ce00/0xcd11f61c1413f093 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d80a expref: 16 pid: 17144 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.431163:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c422270600) 00010000:00010000:3.0:1788664492.431168:0:17128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413f0cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.431177:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413f0cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.431185:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413f0cb lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.431215:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664492.431353:0:17143:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413f0cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.431362:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413f0cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664492.431479:0:17143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788664492.431617:0:17143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788664492.431657:0:17143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1788664492.431732:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17143:1875550140589568:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788664492.431809:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664492.431838:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c404735000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664492.432260:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3038b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+18:2391:x1875550119539456:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 1188us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664492.432269:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1788664492.433079:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140589568 00000100:00100000:1.0:1788664492.433089:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140589568 00000100:00100000:1.0:1788664492.433138:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788664492.433171:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17143:x1875550140589568:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788664492.433278:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17143:x1875550140589568:12345-0@lo:1000:mdt00_000.0 Request processed in 108us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664492.433285:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788664492.433699:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c303abd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17143:1875550140589568:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788664492.434066:0:17143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1788664492.434137:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17143:1875550140589696:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788664492.434187:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664492.434299:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42f6ba180 going to sleep for 11 seconds 00000100:00100000:1.0:1788664492.434459:0:17883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140589696 00000100:00100000:1.0:1788664492.434466:0:17883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140589696 00000100:00100000:1.0:1788664492.434534:0:17883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788664492.434543:0:17883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17143:x1875550140589696:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788664492.434721:0:17883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17143:x1875550140589696:12345-0@lo:1000:mdt00_000.0 Request processed in 179us (534us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788664492.434729:0:17883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788664492.435132:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17143:1875550140589696:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788664492.435170:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413f0cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.435191:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413f0cb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.435199:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413f0cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.435205:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84000 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664492.435209:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413f0cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.435217:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413f0cb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.435233:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c422270600) 00010000:00010000:3.0:1788664492.435236:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664492.435240:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413f0cb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.435247:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84000/0xcd11f61c1413f0cb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.435277:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dea00/0xcd11f61c1413f023 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.435283:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dea00/0xcd11f61c1413f023 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.435289:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dea00/0xcd11f61c1413f023 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.435294:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7dea00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664492.435304:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dea00/0xcd11f61c1413f023 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.435311:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dea00/0xcd11f61c1413f023 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.435330:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:3.0:1788664492.435333:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664492.435340:0:17143:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413f02a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7ee expref: 18 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.435352:0:17143:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413f02a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7ee expref: 18 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.435362:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413f02a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7ee expref: 18 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.435417:0:17143:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0d000/0xcd11f61c1413f02a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d7ee expref: 18 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664492.435431:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1875550140589824:192.168.203.52@tcp:105: 00000100:00100000:3.0:1788664492.435541:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c42f6ba600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664492.438482:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1875550140589824:192.168.203.52@tcp:105: 00010000:00010000:3.0:1788664492.438518:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dea00/0xcd11f61c1413f023 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.438528:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dea00/0xcd11f61c1413f023 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.438710:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413f0d2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.438726:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413f0d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.438738:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413f0d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.438748:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413f0d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.438754:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413f0d2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.438760:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413f0d2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.438765:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c303b84a00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664492.438850:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413f0d2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.438859:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413f0d2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.438870:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:3.0:1788664492.438873:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664492.438876:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413f0d2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.438882:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c303b84a00/0xcd11f61c1413f0d2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.439737:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413f0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.439744:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413f0c4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.439750:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413f0c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.439756:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0c200 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:3.0:1788664492.439760:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413f0c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.439768:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413f0c4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.439817:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:3.0:1788664492.439820:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788664492.439824:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413f0c4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664492.439830:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0c200/0xcd11f61c1413f0c4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788664492.440131:0:17178:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788664492.440135:0:17178:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788664492.440152:0:17178:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788664492.440158:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788664492.440519:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+18:15684:x1875550119539200:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 33092us (33350us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1788664492.440530:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000020:00080000:3.0:1788664492.440537:0:17143:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788664492.441309:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664492.441447:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119539584 00000100:00100000:2.0:1788664492.441456:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119539584 00000100:00100000:2.0:1788664492.441502:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1788664492.441511:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+18:15683:x1875550119539584:12345-192.168.203.52@tcp:49:bash.0 00000100:00100000:2.0:1788664492.441635:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+18:15683:x1875550119539584:12345-192.168.203.52@tcp:49:bash.0 Request processed in 125us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664492.441643:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1788664492.447080:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664492.447174:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119539840 00000100:00100000:2.0:1788664492.447185:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119539840 00000100:00100000:2.0:1788664492.447238:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1788664492.447249:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+18:15684:x1875550119539840:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788664492.447534:0:17147:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788664492.447566:0:17147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1788664492.447618:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413f0d9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.447635:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413f0d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.447646:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413f0d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.447671:0:17147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413f0d9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.447679:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413f0d9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.447685:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413f0d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.447710:0:17147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788664492.447832:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+20:15684:x1875550119539840:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 584us (761us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1788664492.447841:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000020:00080000:2.0:1788664492.447846:0:17147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788664492.448153:0:19537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664492.448160:0:19537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413f0d9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.448167:0:19537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c402a0ca00 already unused, calling callback (ffffffffc0c117b0) 00010000:00010000:0.0:1788664492.448171:0:19537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413f0d9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.448179:0:19537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413f0d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.448192:0:19537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c422270600) 00010000:00010000:0.0:1788664492.448196:0:19537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788664492.448200:0:19537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413f0d9 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.448207:0:19537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c402a0ca00/0xcd11f61c1413f0d9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.448219:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664492.448220:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664492.448222:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664492.455933:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664492.456129:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119539968 00000100:00100000:2.0:1788664492.456141:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119539968 00000100:00100000:2.0:1788664492.456220:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:2.0:1788664492.456232:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+7:15683:x1875550119539968:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788664492.456252:0:18649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664492.456271:0:18649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413f0e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d826 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664492.456320:0:18649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9cdaab, atime: 0x6a9cdaa9, ctime: 0x6a9cdaab, blocks: 0x0 00010000:00010000:2.0:1788664492.456353:0:18649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=587s v=(0 0) 00010000:00010000:2.0:1788664492.456358:0:18649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664492.456368:0:18649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413f0e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d826 expref: 8 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.456405:0:18649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e51daa/0xcd11f61c1413f0e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d826 expref: 8 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664492.456417:0:18649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c402a0c600, rc 0) 00000100:00100000:2.0:1788664492.456480:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+8:15683:x1875550119539968:12345-192.168.203.52@tcp:101:bash.0 Request processed in 250us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664492.456487:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:1.0:1788664492.461985:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664492.462267:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119540096 00000100:00100000:0.0:1788664492.462278:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119540096 00000100:00100000:0.0:1788664492.462389:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:0.0:1788664492.462538:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+20:15683:x1875550119540096:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788664492.462585:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664492.462761:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cce00/0xcd11f61c1413f0e7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d82d expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.462827:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413f0ee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.462841:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413f0ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.462853:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413f0ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.463025:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cce00/0xcd11f61c1413f0e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d82d expref: 22 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.463044:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7cd000/0xcd11f61c1413f0ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d82d expref: 21 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664492.463052:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:0.0:1788664492.463055:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788664492.463059:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c42e7cd000, rc 0) 00000100:00100000:0.0:1788664492.463122:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+21:15683:x1875550119540096:12345-192.168.203.52@tcp:101:bash.0 Request processed in 724us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664492.463130:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:1.0:1788664492.475833:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664492.476042:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119540352 00000100:00100000:2.0:1788664492.476054:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119540352 00000100:00100000:2.0:1788664492.476115:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1788664492.476126:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3036f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+21:15683:x1875550119540352:12345-192.168.203.52@tcp:35:bash.0 00000001:00080000:2.0:1788664492.476528:0:17147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1788664492.476691:0:17147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1788664492.476899:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3036f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+24:15683:x1875550119540352:12345-192.168.203.52@tcp:35:bash.0 Request processed in 774us (1075us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1788664492.476909:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000020:00080000:2.0:1788664492.476915:0:17147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788664492.626874:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664492.627160:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119540608 00000100:00100000:1.0:1788664492.627171:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119540608 00000100:00100000:1.0:1788664492.627230:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:1.0:1788664492.627241:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c303abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+24:15694:x1875550119540608:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788664492.627267:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664492.627352:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df000/0xcd11f61c1413f0f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8fdc38bbf293d834 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664492.627473:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788664492.627873:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df000/0xcd11f61c1413f0f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d834 expref: 26 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.627900:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c3027e6300) 00010000:00010000:1.0:1788664492.627903:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788664492.627910:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df000/0xcd11f61c1413f0f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x8fdc38bbf293d834 expref: 26 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.627931:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c42e7df000, rc 0) 00000100:00100000:1.0:1788664492.628027:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c303abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+25:15694:x1875550119540608:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 786us (1161us total) trans 8589934634 rc 301/301 00000100:00100000:1.0:1788664492.628036:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:3.0:1788664492.632395:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664492.632531:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119540736 00000100:00100000:1.0:1788664492.632542:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119540736 00000100:00100000:1.0:1788664492.632614:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:1.0:1788664492.632625:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+25:15694:x1875550119540736:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:1.0:1788664492.632703:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df400/0xcd11f61c1413f103 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.632720:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df400/0xcd11f61c1413f103 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.632730:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df400/0xcd11f61c1413f103 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.632745:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df800/0xcd11f61c1413f10a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.632767:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df800/0xcd11f61c1413f10a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.632798:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df800/0xcd11f61c1413f10a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.632931:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfa00/0xcd11f61c1413f111 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.632941:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfa00/0xcd11f61c1413f111 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.632948:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfa00/0xcd11f61c1413f111 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788664492.632994:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfa00/0xcd11f61c1413f111 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633007:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df400/0xcd11f61c1413f103 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633014:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df400/0xcd11f61c1413f103 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633021:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df400/0xcd11f61c1413f103 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633027:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7df400 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.633031:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df400/0xcd11f61c1413f103 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633038:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df400/0xcd11f61c1413f103 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633057:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c303884900) 00010000:00010000:1.0:1788664492.633061:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664492.633066:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df400/0xcd11f61c1413f103 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633073:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df400/0xcd11f61c1413f103 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633087:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df800/0xcd11f61c1413f10a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633093:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df800/0xcd11f61c1413f10a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633099:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df800/0xcd11f61c1413f10a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633105:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7df800 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.633108:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df800/0xcd11f61c1413f10a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633114:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df800/0xcd11f61c1413f10a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633121:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93c3027e6200) 00010000:00010000:1.0:1788664492.633123:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664492.633126:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df800/0xcd11f61c1413f10a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633131:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7df800/0xcd11f61c1413f10a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633271:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfa00/0xcd11f61c1413f111 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633279:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfa00/0xcd11f61c1413f111 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633285:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfa00/0xcd11f61c1413f111 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633291:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c42e7dfa00 already unused, calling callback (ffffffffc18424f0) 00010000:00010000:1.0:1788664492.633293:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfa00/0xcd11f61c1413f111 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633300:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfa00/0xcd11f61c1413f111 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633308:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c422270b00) 00010000:00010000:1.0:1788664492.633311:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664492.633314:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfa00/0xcd11f61c1413f111 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664492.633319:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c42e7dfa00/0xcd11f61c1413f111 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664492.633454:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+25:15694:x1875550119540736:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 829us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664492.633463:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:0.0:1788664492.640758:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664492.641044:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119540992 00000100:00100000:1.0:1788664492.641056:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119540992 00000100:00100000:1.0:1788664492.641143:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1788664492.641175:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+25:15694:x1875550119540992:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788664492.641419:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+26:15694:x1875550119540992:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 246us (670us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1788664492.641427:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1788664492.697383:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664492.697444:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664492.698178:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119541120 00000100:00100000:1.0:1788664492.698190:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119541120 00000100:00100000:1.0:1788664492.698254:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:1.0:1788664492.698265:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c403ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+13:2392:x1875550119541120:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788664492.698358:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c403ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a698de9a-812c-492b-8656-53dc2bcfa114+13:2392:x1875550119541120:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 95us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664492.698366:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:3.0:1788664492.698823:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664492.698914:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119541376 00000100:00100000:0.0:1788664492.698927:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119541376 00000100:00100000:0.0:1788664492.698973:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1788664492.698991:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2392:x1875550119541376:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664492.699039:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2392:x1875550119541376:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 59us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664492.699046:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:3.0:1788664492.701281:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788664492.701338:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664492.701404:0:19229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119541888 00000100:00100000:0.0:1788664492.701413:0:19229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119541888 00000100:00100000:0.0:1788664492.701469:0:19229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1788664492.701478:0:19229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2392:x1875550119541888:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664492.701549:0:19229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2392:x1875550119541888:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 72us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664492.701557:0:19229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00080000:1.0:1788664492.701904:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664492.706338:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788664492.707786:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119541632 00000100:00100000:2.0:1788664492.707801:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119541632 00000100:00100000:2.0:1788664492.707902:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119541248 00000100:00100000:2.0:1788664492.707905:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119541248 00000100:00080000:0.0:1788664492.708141:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788664492.708189:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:0.0:1788664492.708201:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2392:x1875550119541632:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664492.708296:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2392:x1875550119541632:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 98us (9473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664492.708304:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:2.0:1788664492.708502:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:2.0:1788664492.708511:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2392:x1875550119541248:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788664492.708545:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+5:2392:x1875550119541248:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (7223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664492.708564:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:3.0:1788664492.709804:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664492.710461:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119541760 00000100:00100000:0.0:1788664492.710472:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119541760 00000100:00100000:0.0:1788664492.710544:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:0.0:1788664492.710554:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2392:x1875550119541760:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664492.710637:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24b2763c-9677-4c1d-9630-d8d0d4c5653c+5:2392:x1875550119541760:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 84us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664492.710645:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:0.0:1788664492.710854:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119541504 00000100:00100000:0.0:1788664492.711214:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119541504 00000100:00100000:0.0:1788664492.711255:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:0.0:1788664492.711263:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:2392:x1875550119541504:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788664492.711302:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24b2763c-9677-4c1d-9630-d8d0d4c5653c+6:2392:x1875550119541504:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 40us (4985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664492.711309:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00080000:3.0:1788664492.712199:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664492.712206:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788664492.734331:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664493.758633:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664494.784136:0:19537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788664494.850025:0:20321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:0.0:1788664495.256420:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788664495.256475:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788664495.256706:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119542016 00000100:00100000:1.0:1788664495.256718:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119542016 00002000:00100000:1.0:1788664495.256824:0:18654:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff93c301ea8700 x1875550119542016/t0(0) o4->a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8@192.168.203.52@tcp:46/0 lens 504/0 e 0 to 0 dl 1788664506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788664495.256835:0:18654:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c301ea8700 with x1875550119542016 ext(0->8) 00002000:00010000:1.0:1788664495.256841:0:18654:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c301ea8700 00000100:00100000:1.0:1788664495.256864:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1788664495.256874:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c301ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+8:2393:x1875550119542016:12345-192.168.203.52@tcp:4:bash.0 00000100:00100000:1.0:1788664495.258395:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c301ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+10:2393:x1875550119542016:12345-192.168.203.52@tcp:4:bash.0 Request processed in 1509us (1972us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788664495.258413:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00002000:00100000:1.0:1788664495.258445:0:18654:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff93c301ea8700 x1875550119542016/t8589934599(0) o4->a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8@192.168.203.52@tcp:46/0 lens 504/448 e 0 to 0 dl 1788664506 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788664495.258456:0:18654:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c301ea8700 with x1875550119542016 ext(0->8) 00002000:00010000:1.0:1788664495.258463:0:18654:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c301ea8700 00000100:00080000:3.0:1788664495.262999:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664495.264502:0:19534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550119542144 00000100:00100000:2.0:1788664495.264518:0:19534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550119542144 00000100:00100000:1.0:1788664495.266222:0:19534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1788664495.266239:0:19534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c4350fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+10:2393:x1875550119542144:12345-192.168.203.52@tcp:16:kworker.0 00000001:00080000:2.0:1788664495.270581:0:18645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1788664495.270599:0:18645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000100:00100000:1.0:1788664495.286549:0:19534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c4350fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a30d548b-3f9a-4863-9c6b-5a5f93cbe0f8+6:2393:x1875550119542144:12345-192.168.203.52@tcp:16:kworker.0 Request processed in 20303us (30061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664495.286573:0:19534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00010000:00010000:0.0:1788664495.806038:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664496.199617:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664496.199645:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140589952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788664496.199742:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664496.199924:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550140589952 00000100:00100000:2.0:1788664496.199934:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550140589952 00000100:00100000:2.0:1788664496.200008:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788664496.200021:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c3039d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140589952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788664496.200050:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923513344 avail 3691962368 00000100:00100000:2.0:1788664496.200106:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c3039d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875550140589952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664496.200113:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788664496.200177:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c3039d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1875550140589952:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788664496.200501:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 Debug log: 43613 lines, 43613 kept, 0 dropped, 0 bad.